00000001:02000400:1.0F:1788850781.410999:0:3305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_hostid 00000001:02000400:1.0:1788850799.699094:0:3525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788850801.472484:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 755 MB/s 00000001:01000000:2.0F:1788850801.722718:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 639 MB/s 00000001:01000000:3.0:1788850801.972300:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3559 MB/s 00000020:02000000:2.0:1788850802.626568:0:3616:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ga87ca5d 00000400:02000000:0.0F:1788850803.512368:0:3631:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.127@tcp [8/256/0/180] 00008000:02000000:1.0:1788850806.680041:0:3781:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788850869.614511:0:5761:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788850881.570471:0:6511:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788850881.570480:0:6511:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788850881.570482:0:6511:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788850881.570620:0:6511:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f4ff9ed4 00000080:02000400:2.0:1788850881.570631:0:6511:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788850881.593654:0:6511:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788850881.593669:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788850881.596580:0:6511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006903a6c7) 00000020:00000080:2.0:1788850881.596602:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788850881.662488:0:6511:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788850881.662567:0:6511:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788850881.680625:0:6511:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788850881.680826:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788850881.680833:0:6511:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788850881.680844:0:6511:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b205420 00000020:01000004:2.0:1788850881.680851:0:6511:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788850881.680855:0:6511:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788850881.680858:0:6511:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f4ff9ed4 from MGS 00000020:01000004:2.0:1788850881.680862:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788850881.680871:0:6511:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000015f0e1be) 00000020:00000080:2.0:1788850881.680880:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788850881.680935:0:6511:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f4ff9ed4 from MGS, refs=2 00080000:01000000:2.0:1788850881.680939:0:6511:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788850881.680944:0:6511:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b20542e 00000100:00100000:2.0:1788850881.681121:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788850881.681260:0:6511:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788850881.681266:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788850881.682360:0:6511:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788850881.682368:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788850881.685677:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850881.685849:0:6511:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788850881.685856:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788850881.686424:0:6511:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788850881.686432:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788850881.691479:0:6511:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788850881.691491:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788850881.694334:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850881.694395:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850881.694398:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850881.694642:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850881.694644:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850881.694646:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850881.695118:0:6511:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788850881.700341:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788850881.944110:0:6511:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3975 MB/s 00000001:01000000:0.0:1788850882.195320:0:6511:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3095 MB/s 00000001:01000000:2.0:1788850882.445249:0:6511:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 687 MB/s 00000001:01000000:3.0:1788850882.695133:0:6511:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 791 MB/s 00080000:10000000:2.0:1788850882.700556:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788850882.711642:0:6511:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788850882.712563:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788850882.712607:0:6511:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788850882.712640:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788850882.712800:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788850882.712833:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788850882.713528:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788850882.713724:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788850882.713730:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788850882.719530:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788850882.719546:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788850882.723956:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788850882.723971:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788850882.724664:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788850882.724685:0:6511:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.127@tcp' 00000020:01000004:1.0:1788850882.724686:0:6511:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:3.0:1788850882.724996:0:6530:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1788850882.726280:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.127@tcp (typ=mgc) 00000020:00000080:0.0:1788850882.726306:0:6511:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.127@tcp (0000000028e95545) 00000020:00000080:0.0:1788850882.726324:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788850882.726479:0:6511:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000984c0d29@MGC192.168.204.127@tcp: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788850882.726653:0:6511:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.127@tcp-0 is initialized 00000040:01000000:0.0:1788850882.726660:0:6511:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788850882.734357:0:6531:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788850882.735386:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.127@tcp (uuid 5c5226fe-29cd-49fb-9546-e50c12b232cb) 00000020:00000080:2.0:1788850882.735482:0:6511:0:(genops.c:1384:class_connect()) connect: client 5c5226fe-29cd-49fb-9546-e50c12b232cb, cookie 0x3e0030720b20543c 00000100:00080000:2.0:1788850882.735495:0:6511:0:(import.c:545:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788850882.735502:0:6511:0:(import.c:666:import_select_connection()) MGC192.168.204.127@tcp: import 00000000984c0d29 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788850882.735542:0:6511:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aa8176c2 x1875746019606656/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788850882.735615:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa8176c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c5226fe-29cd-49fb-9546-e50c12b232cb:3646:1875746019606656:0@lo:250: 00000100:00100000:2.0:1788850882.735670:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788850882.735715:0:6511:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS 00000020:01000004:2.0:1788850882.735733:0:6511:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788850882.735749:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788850882.735762:0:6511:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b9dbd7e4) 00000020:00000080:2.0:1788850882.735773:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788850882.735929:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019606656 00000100:00100000:0.0:1788850882.735937:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019606656 00000100:00100000:0.0:1788850882.735965:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788850882.735971:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007d7ad4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875746019606656:12345-0@lo:250: 00010000:00080000:0.0:1788850882.735992:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5c5226fe-29cd-49fb-9546-e50c12b232cb@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1788850882.736025:0:6526:0:(genops.c:1384:class_connect()) connect: client 5c5226fe-29cd-49fb-9546-e50c12b232cb, cookie 0x3e0030720b20544a 00000100:00080000:0.0:1788850882.736174:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000b091d038 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788850882.736245:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007d7ad4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:3646:x1875746019606656:12345-0@lo:250: Request processed in 274us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850882.736253:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850882.736346:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788850882.736355:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.127@tcp: connect to target with instance 0 00000100:00080000:2.0:1788850882.736361:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788850882.736365:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788850882.736368:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000984c0d29 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788850882.736371:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788850882.736387:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788850882.736392:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa8176c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c5226fe-29cd-49fb-9546-e50c12b232cb:3646:1875746019606656:0@lo:250: 00010000:00010000:0.0:1788850882.745554:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850882.759671:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850882.759975:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788850882.759982:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788850882.763934:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788850882.763966:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788850882.767748:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788850882.767763:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788850882.768792:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788850882.769263:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788850882.769269:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788850882.777159:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788850882.777174:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788850882.822226:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788850882.823399:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788850882.823408:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788850882.826066:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788850882.826081:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788850882.827442:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788850882.827684:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788850882.827691:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788850882.828509:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788850882.828518:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788850882.829473:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788850882.829643:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788850882.829648:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788850882.830585:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788850882.830594:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788850882.832078:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850882.832253:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788850882.832259:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788850882.832761:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788850882.832777:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788850882.851655:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788850882.851957:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788850882.851964:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788850882.853357:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788850882.853368:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788850882.854525:0:6511:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788850882.854535:0:6511:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788850882.855647:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788850882.855675:0:6511:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788850882.855682:0:6511:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788850882.855784:0:6511:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788850882.855904:0:6511:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788850882.855908:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788850882.855910:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788850882.855911:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788850882.855917:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788850882.855919:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788850882.855920:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788850882.855921:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788850882.855922:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788850882.855923:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788850882.855924:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788850882.855925:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788850882.855926:0:6511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788850882.855929:0:6511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788850882.855931:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788850882.855931:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788850882.855932:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788850882.855933:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788850882.855934:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788850882.855935:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788850882.855936:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788850882.855937:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788850882.855938:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788850882.855938:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788850882.855939:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788850882.855940:0:6511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788850882.856122:0:6511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788850882.856140:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034345e2b pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019606784:0@lo:253: 00000100:00100000:3.0:1788850882.856220:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850882.856312:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000506750a7 going to sleep for 11 seconds 00000100:00100000:1.0:1788850882.856371:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019606784 00000100:00100000:1.0:1788850882.856380:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019606784 00000100:00100000:1.0:1788850882.856458:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788850882.856468:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e26fa8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:6511:x1875746019606784:12345-0@lo:253: 20000000:01000000:1.0:1788850882.856512:0:6529:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788850882.856516:0:6529:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788850882.856845:0:6550:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788850882.856966:0:6529:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788850882.857320:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788850882.858226:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788850882.859453:0:6529:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788850882.859458:0:6529:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788850882.859464:0:6529:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788850882.859467:0:6529:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788850882.859481:0:6529:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788850882.859653:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850882.860786:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788850882.860817:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788850882.860841:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788850882.860858:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788850882.860873:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788850882.860938:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788850882.860946:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788850882.860959:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788850882.860965:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788850882.860977:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788850882.860998:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788850882.861031:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788850882.861058:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788850882.861090:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788850882.861096:0:6529:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788850882.861102:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850882.861242:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788850882.861252:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788850882.861268:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788850882.861283:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788850882.861314:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788850882.861324:0:6529:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788850882.861350:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788850882.861357:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788850882.861369:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788850882.861383:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788850882.861397:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788850882.861406:0:6529:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788850882.861428:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788850882.861435:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788850882.861446:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788850882.861460:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788850882.861521:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788850882.861545:0:6529:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788850882.861552:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788850882.862751:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788850882.862945:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788850882.862965:0:6529:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.127@tcp for mdt 20000000:01000000:1.0:1788850882.862967:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1788850882.863234:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788850882.863243:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788850882.863259:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788850882.863264:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1788850882.863297:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788850882.863306:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788850882.863321:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788850882.863349:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788850882.863380:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788850882.863383:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788850882.863387:0:6529:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788850882.863444:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788850882.863446:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788850882.864173:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788850882.864729:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788850882.864756:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788850882.864770:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788850882.864781:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788850882.864783:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788850882.865721:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788850882.865951:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788850882.865989:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788850882.866007:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788850882.866073:0:6529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788850882.866075:0:6529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788850882.866080:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788850882.866082:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788850882.866087:0:6529:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788850882.866093:0:6529:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788850882.866586:0:6555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788850882.868654:0:6529:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788850882.884244:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788850882.884911:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788850882.884934:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788850882.884957:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788850882.885123:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885142:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885152:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885158:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885164:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885170:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885177:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000402bb0ed already unused, calling callback (00000000a093a272) 00010000:00010000:3.0:1788850882.885179:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885199:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885211:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885217:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.885222:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000402bb0ed/0x3e0030720b205451 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788850882.885237:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788850882.908994:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e26fa8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:6511:x1875746019606784:12345-0@lo:253: Request processed in 52519us (52765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850882.909054:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850882.909076:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034345e2b pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019606784:0@lo:253: 10000000:01000000:0.0:1788850882.909092:0:6511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788850882.909094:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788850882.909096:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788850882.909097:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850882.909099:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788850882.909100:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850882.909101:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850882.909102:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788850882.909104:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788850882.909105:0:6511:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788850882.909107:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850882.909108:0:6511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788850882.909129:0:6511:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f4ff9ed4 from lustre-MDT0000 10000000:01000000:0.0:1788850882.909161:0:6511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788850882.909181:0:6511:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788850882.909185:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff892ebbbc99c0 10000000:01000000:0.0:1788850882.909189:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788850882.909197:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff892ebbbc99c0 from 1 10000000:01000000:0.0:1788850882.909201:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788850882.909254:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850882.909264:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850882.909272:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850882.909299:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3946017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019606912:0@lo:101: 00000100:00100000:0.0:1788850882.909336:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850882.909418:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019606912 00000100:00100000:3.0:1788850882.909425:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019606912 00000100:00100000:0.0:1788850882.909446:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d48ea82 going to sleep for 11 seconds 00000100:00100000:3.0:1788850882.910990:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788850882.911009:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080c4f3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:6511:x1875746019606912:12345-0@lo:101: 00010000:00010000:3.0:1788850882.911041:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850882.911070:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205458 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.911100:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205458 expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.911110:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205458 expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.911135:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000402bb0ed, rc 0) 00000100:00100000:3.0:1788850882.911260:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080c4f3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:6511:x1875746019606912:12345-0@lo:101: Request processed in 260us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850882.911267:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788850882.911508:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3946017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019606912:0@lo:101: 00010000:00010000:1.0:1788850882.911525:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850882.911538:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850882.911623:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607040:0@lo:501: 00000100:00100000:1.0:1788850882.911737:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850882.911833:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c652545 going to sleep for 11 seconds 00000100:00100000:3.0:1788850882.911938:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607040 00000100:00100000:3.0:1788850882.911945:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607040 00000100:00100000:3.0:1788850882.911986:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850882.911992:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000075004b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:6511:x1875746019607040:12345-0@lo:501: 00000100:00100000:3.0:1788850882.912104:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000075004b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:6511:x1875746019607040:12345-0@lo:501: Request processed in 112us (444us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788850882.912111:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788850882.912235:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607040:0@lo:501: 10000000:01000000:1.0:1788850882.912262:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788850882.912283:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850882.912291:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850882.912306:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892e91596800 10000000:01000000:1.0:1788850882.912310:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788850882.912315:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff892e91596800 10000000:01000000:1.0:1788850882.912317:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788850882.912320:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff892e91596800 from 1 10000000:01000000:1.0:1788850882.912322:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788850882.912343:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000aee02c23/0x3e0030720b205466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850882.912351:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000aee02c23/0x3e0030720b205466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850882.912359:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000aee02c23/0x3e0030720b205466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850882.912370:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607168:0@lo:101: 00000100:00100000:1.0:1788850882.912395:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850882.912413:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c652545 going to sleep for 11 seconds 00000100:00100000:3.0:1788850882.912471:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607168 00000100:00100000:3.0:1788850882.912475:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607168 00000100:00100000:3.0:1788850882.912492:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788850882.912496:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000947c8695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:6511:x1875746019607168:12345-0@lo:101: 00010000:00010000:3.0:1788850882.912503:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850882.912512:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009caf4d3e/0x3e0030720b20546d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205466 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.912527:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009caf4d3e/0x3e0030720b20546d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205466 expref: 7 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.912534:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009caf4d3e/0x3e0030720b20546d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205466 expref: 7 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.912541:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009caf4d3e, rc 0) 00000100:00100000:3.0:1788850882.912575:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000947c8695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+7:6511:x1875746019607168:12345-0@lo:101: Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850882.912588:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788850882.912668:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607168:0@lo:101: 00010000:00010000:1.0:1788850882.912679:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000aee02c23/0x3e0030720b205466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850882.912687:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000aee02c23/0x3e0030720b205466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850882.912699:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788850882.912709:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000aee02c23/0x3e0030720b205466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850882.912725:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000aee02c23/0x3e0030720b205466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850882.912731:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788850882.912734:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788850882.912737:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff892e91596800 10000000:01000000:1.0:1788850882.912739:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788850882.912742:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788850882.912744:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788850882.912756:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850882.912762:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850882.912768:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850882.912777:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607296:0@lo:101: 00000100:00100000:1.0:1788850882.912801:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850882.912825:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c652545 going to sleep for 11 seconds 00000100:00100000:3.0:1788850882.913041:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607296 00000100:00100000:3.0:1788850882.913055:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607296 00000100:00100000:3.0:1788850882.913075:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850882.913080:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006367358 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+7:6511:x1875746019607296:12345-0@lo:101: 00010000:00010000:3.0:1788850882.913087:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850882.913094:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205474 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.913107:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205474 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.913114:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205474 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850882.913120:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004d7638f, rc 0) 00000100:00100000:3.0:1788850882.913147:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006367358 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+8:6511:x1875746019607296:12345-0@lo:101: Request processed in 66us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850882.913152:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788850882.913287:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607296:0@lo:101: 00010000:00010000:1.0:1788850882.913296:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850882.913303:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850882.913360:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607424:0@lo:501: 00000100:00100000:1.0:1788850882.913384:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850882.913411:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c652545 going to sleep for 11 seconds 00000100:00100000:0.0:1788850882.913487:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607424 00000100:00100000:0.0:1788850882.913492:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607424 00000100:00100000:0.0:1788850882.913509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788850882.913514:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000596c2167 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+8:6511:x1875746019607424:12345-0@lo:501: 00000100:00100000:0.0:1788850882.913632:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000596c2167 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6511:x1875746019607424:12345-0@lo:501: Request processed in 118us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850882.913639:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788850882.913755:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607424:0@lo:501: 00000100:00100000:1.0:1788850882.913777:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607552:0@lo:503: 00000100:00100000:1.0:1788850882.913822:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850882.914685:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c652545 going to sleep for 11 seconds 00000100:00100000:3.0:1788850882.919402:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607552 00000100:00100000:3.0:1788850882.919420:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607552 00000100:00100000:3.0:1788850882.919471:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788850882.919480:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f398137c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6511:x1875746019607552:12345-0@lo:503: 00000100:00100000:3.0:1788850882.919647:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f398137c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6511:x1875746019607552:12345-0@lo:503: Request processed in 168us (5823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850882.919654:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788850882.921986:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607552:0@lo:503: 00000100:00100000:1.0:1788850882.922771:0:6556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:6556:1875746019607680:0@lo:502: 00000100:00100000:1.0:1788850882.922854:0:6556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850882.922905:0:6556:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f07e2e4 going to sleep for 11 seconds 00000100:00100000:3.0:1788850882.923161:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607680 00000100:00100000:3.0:1788850882.923168:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607680 00000100:00100000:3.0:1788850882.923209:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788850882.923216:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7a5b801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6556:x1875746019607680:12345-0@lo:502: 00000100:00100000:3.0:1788850882.923333:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7a5b801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6556:x1875746019607680:12345-0@lo:502: Request processed in 117us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850882.923341:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788850882.923433:0:6556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:6556:1875746019607680:0@lo:502: 00000020:01000000:1.0:1788850882.923458:0:6556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850882.923468:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850882.923470:0:6556:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788850882.923475:0:6556:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788850882.923477:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788850882.923498:0:6556:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000968ab509) 00000020:00000080:1.0:1788850882.923515:0:6556:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788850882.923521:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788850882.923632:0:6556:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788850882.923639:0:6556:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b205489 00000020:00000080:1.0:1788850882.924103:0:6556:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788850882.924109:0:6556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850882.924112:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850882.924120:0:6556:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788850882.924123:0:6556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850882.924127:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850882.924128:0:6556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788850882.924131:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788850882.924137:0:6556:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000389f2be3) 00000020:00000080:1.0:1788850882.924148:0:6556:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788850882.924152:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788850882.924154:0:6556:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788850882.924156:0:6556:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788850882.924162:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788850882.924204:0:6556:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f4ff9ed4 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788850882.924213:0:6556:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b56d8e6d) 00000020:00000080:1.0:1788850882.924219:0:6556:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788850882.924274:0:6556:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788850882.924279:0:6556:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b20549e 00000020:00000080:1.0:1788850882.924369:0:6556:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788850882.924375:0:6556:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788850882.924380:0:6556:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e0030720b2054a5 00080000:01000000:1.0:1788850882.924385:0:6556:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788850882.924389:0:6556:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b2054ac 00080000:10000000:1.0:1788850882.925253:0:6556:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788850882.925421:0:6556:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788850882.936193:0:6556:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788850883.020132:0:6556:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788850883.020786:0:6556:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788850883.023897:0:6556:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788850883.024743:0:6556:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788850883.028347:0:6556:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000004663834) 00000020:00000080:2.0:1788850883.028370:0:6556:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788850883.028441:0:6556:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788850883.028449:0:6556:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b2054ba 00000020:00000080:1.0:1788850883.030415:0:6556:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788850883.031248:0:6556:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788850883.040402:0:6556:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788850883.042602:0:6556:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788850883.044388:0:6556:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788850883.047185:0:6556:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788850883.050945:0:6556:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788850883.054391:0:6556:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e0030720b2054c1 00000020:00000080:2.0:1788850883.054728:0:6556:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788850883.054739:0:6556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850883.054745:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850883.054747:0:6556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788850883.054750:0:6556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850883.054754:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850883.054755:0:6556:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788850883.054758:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788850883.054759:0:6556:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788850883.054762:0:6556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850883.054764:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850883.054765:0:6556:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788850883.054767:0:6556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850883.054771:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850883.054773:0:6556:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788850883.054776:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788850883.054814:0:6556:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788850883.054864:0:6556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa8176c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:6556:1875746019607808:0@lo:502: 00000100:00100000:2.0:1788850883.058350:0:6556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850883.058410:0:6556:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f1bcc411 going to sleep for 11 seconds 00000100:00100000:3.0:1788850883.058473:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607808 00000100:00100000:3.0:1788850883.058483:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607808 00000100:00100000:3.0:1788850883.058530:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788850883.058538:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b5e71b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6556:x1875746019607808:12345-0@lo:502: 00000100:00100000:3.0:1788850883.058684:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b5e71b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6556:x1875746019607808:12345-0@lo:502: Request processed in 147us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850883.058692:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788850883.058780:0:6556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa8176c2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:6556:1875746019607808:0@lo:502: 00000020:01000000:1.0:1788850883.058814:0:6556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850883.058821:0:6556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850883.058824:0:6556:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788850883.058830:0:6556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788850883.059000:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788850883.059056:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788850883.059074:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.059085:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850883.059093:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e91596800 from 1 10000000:01000000:3.0:1788850883.059097:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788850883.059128:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.059136:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.059156:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850883.059173:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607936:0@lo:101: 00000100:00100000:3.0:1788850883.059206:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850883.059522:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000967b4d0c going to sleep for 11 seconds 00000100:00100000:2.0:1788850883.059576:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607936 00000100:00100000:2.0:1788850883.059582:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607936 00000100:00100000:2.0:1788850883.059613:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788850883.059627:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f5829041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6511:x1875746019607936:12345-0@lo:101: 00010000:00010000:2.0:1788850883.059641:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850883.059654:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2054c8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.059952:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2054c8 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.059962:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2054c8 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.059969:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab535c36, rc 0) 00000100:00100000:2.0:1788850883.061000:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f5829041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+10:6511:x1875746019607936:12345-0@lo:101: Request processed in 1371us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850883.061020:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788850883.061284:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019607936:0@lo:101: 00010000:00010000:3.0:1788850883.061312:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.061324:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850883.062216:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608064:0@lo:256: 00000100:00100000:3.0:1788850883.062275:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850883.062306:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000967b4d0c going to sleep for 11 seconds 00000100:00100000:0.0:1788850883.062371:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608064 00000100:00100000:0.0:1788850883.062379:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608064 00000100:00100000:0.0:1788850883.062511:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788850883.062520:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de9e60ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+10:6511:x1875746019608064:12345-0@lo:256: 20000000:01000000:0.0:1788850883.062538:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788850883.062550:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788850883.062625:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de9e60ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+10:6511:x1875746019608064:12345-0@lo:256: Request processed in 107us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850883.062632:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788850883.062705:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608064:0@lo:256: 10000000:01000000:3.0:1788850883.063304:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788850883.063323:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.063334:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850883.063342:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e91596800 from 1 10000000:01000000:3.0:1788850883.063344:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788850883.063949:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.063956:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.063964:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850883.063979:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608192:0@lo:101: 00000100:00100000:3.0:1788850883.064058:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850883.064472:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000967b4d0c going to sleep for 11 seconds 00000100:00100000:1.0:1788850883.064529:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608192 00000100:00100000:1.0:1788850883.064536:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608192 00000100:00100000:1.0:1788850883.064569:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788850883.064574:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b2ba23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+10:6511:x1875746019608192:12345-0@lo:101: 00010000:00010000:1.0:1788850883.064586:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850883.064601:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2054d6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850883.064620:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2054d6 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850883.064629:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2054d6 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850883.064636:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b83ab48, rc 0) 00000100:00100000:1.0:1788850883.064764:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b2ba23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:6511:x1875746019608192:12345-0@lo:101: Request processed in 188us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850883.064769:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788850883.064934:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608192:0@lo:101: 00010000:00010000:3.0:1788850883.064947:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.064954:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850883.065164:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608320:0@lo:501: 00000100:00100000:3.0:1788850883.065191:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850883.065249:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000967b4d0c going to sleep for 11 seconds 00000100:00100000:1.0:1788850883.065286:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608320 00000100:00100000:1.0:1788850883.065290:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608320 00000100:00100000:1.0:1788850883.065352:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788850883.065359:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a5abf83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:6511:x1875746019608320:12345-0@lo:501: 00000100:00100000:1.0:1788850883.065509:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a5abf83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:6511:x1875746019608320:12345-0@lo:501: Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850883.065532:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788850883.065593:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608320:0@lo:501: 00000100:00100000:3.0:1788850883.065618:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608448:0@lo:503: 00000100:00100000:3.0:1788850883.065654:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850883.065825:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000967b4d0c going to sleep for 11 seconds 00000100:00100000:0.0:1788850883.065959:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608448 00000100:00100000:0.0:1788850883.065965:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608448 00000100:00100000:0.0:1788850883.065988:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788850883.065994:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c5f7c56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:6511:x1875746019608448:12345-0@lo:503: 00000040:00080000:0.0:1788850883.066066:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788850883.066106:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c5f7c56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:6511:x1875746019608448:12345-0@lo:503: Request processed in 112us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850883.066117:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788850883.066201:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608448:0@lo:503: 00000040:00080000:3.0:1788850883.067187:0:6560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788850883.067380:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788850883.067397:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788850883.067415:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.067425:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850883.067470:0:6511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788850883.067472:0:6511:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892e91596800 10000000:01000000:0.0:1788850883.067475:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892e91596800 10000000:01000000:0.0:1788850883.067478:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788850883.067483:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892e91596800 from 1 10000000:01000000:0.0:1788850883.067486:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788850883.067516:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.067522:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.067538:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850883.067555:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608576:0@lo:101: 00000100:00100000:0.0:1788850883.067607:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850883.067637:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000005861197d going to sleep for 11 seconds 00000100:00100000:0.0:1788850883.067673:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608576 00000100:00100000:0.0:1788850883.067679:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608576 00000100:00100000:0.0:1788850883.067712:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788850883.067720:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b15cbdb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:6511:x1875746019608576:12345-0@lo:101: 00010000:00010000:0.0:1788850883.067733:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850883.067747:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2054e4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.067768:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2054e4 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.067777:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2054e4 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.067786:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034d85f67, rc 0) 00000100:00100000:0.0:1788850883.067838:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b15cbdb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6511:x1875746019608576:12345-0@lo:101: Request processed in 120us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850883.067846:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788850883.067892:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608576:0@lo:101: 00010000:00010000:0.0:1788850883.067906:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.067927:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850883.067982:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608704:0@lo:501: 00000100:00100000:0.0:1788850883.068052:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850883.068068:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000005861197d going to sleep for 11 seconds 00000100:00100000:0.0:1788850883.068082:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608704 00000100:00100000:0.0:1788850883.068086:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608704 00000100:00100000:0.0:1788850883.068106:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788850883.068112:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007bab4412 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6511:x1875746019608704:12345-0@lo:501: 00000100:00100000:0.0:1788850883.068240:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007bab4412 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6511:x1875746019608704:12345-0@lo:501: Request processed in 127us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850883.068246:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788850883.068274:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608704:0@lo:501: 00000100:00100000:0.0:1788850883.068295:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608832:0@lo:503: 00000100:00100000:0.0:1788850883.068329:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850883.068339:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000005861197d going to sleep for 11 seconds 00000100:00100000:0.0:1788850883.068349:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608832 00000100:00100000:0.0:1788850883.068352:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608832 00000100:00100000:0.0:1788850883.068366:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788850883.068370:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d93ee7da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6511:x1875746019608832:12345-0@lo:503: 00000100:00100000:0.0:1788850883.068435:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d93ee7da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6511:x1875746019608832:12345-0@lo:503: Request processed in 65us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850883.068441:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788850883.068474:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019608832:0@lo:503: 00000100:00100000:0.0:1788850883.068627:0:6561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:6561:1875746019608960:0@lo:502: 00000100:00100000:0.0:1788850883.068655:0:6561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850883.068669:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608960 00000100:00100000:0.0:1788850883.068672:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608960 00000100:00100000:0.0:1788850883.068686:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788850883.068690:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064da4250 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6561:x1875746019608960:12345-0@lo:502: 00000100:00100000:0.0:1788850883.068743:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064da4250 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6561:x1875746019608960:12345-0@lo:502: Request processed in 53us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850883.068749:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788850883.068770:0:6561:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f45687b9 going to sleep for 11 seconds 00000100:00100000:0.0:1788850883.068779:0:6561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:6561:1875746019608960:0@lo:502: 00000020:01000004:0.0:1788850883.068824:0:6561:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788850883.068837:0:6561:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000541c919f) 00000020:00000080:0.0:1788850883.068852:0:6561:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788850883.068947:0:6561:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f4ff9ed4 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788850883.068950:0:6561:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f4ff9ed4 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788850883.068953:0:6561:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f4ff9ed4 4 00010000:00080000:0.0:1788850883.068977:0:6561:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005dbb1121@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788850883.071441:0:6561:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788850883.071760:0:6561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788850883.071872:0:6561:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788850883.071885:0:6561:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e0030720b2054f9 00000100:00080000:0.0:1788850883.071894:0:6561:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788850883.071905:0:6561:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005dbb1121 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788850883.071938:0:6561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dbf00d4d x1875746019609088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788850883.071964:0:6561:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788850883.072092:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019609088:0@lo:38: 00000100:00100000:2.0:1788850883.072157:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850883.072222:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609088 00000100:00100000:2.0:1788850883.072229:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609088 00000100:00100000:2.0:1788850883.072259:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850883.072265:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1eae2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019609088:12345-0@lo:38: 00000100:00100000:2.0:1788850883.072314:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1eae2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019609088:12345-0@lo:38: Request processed in 49us (158us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788850883.072321:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850883.072355:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788850883.072361:0:3646:0:(import.c:65:import_set_state_nolock()) 000000005dbb1121 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788850883.072365:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788850883.072367:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbf00d4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019609088:0@lo:38: 00000100:00100000:2.0:1788850883.072726:0:6561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:6561:1875746019609216:0@lo:502: 00000100:00100000:2.0:1788850883.072771:0:6561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850883.072794:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609216 00000100:00100000:2.0:1788850883.072798:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609216 00000100:00100000:2.0:1788850883.072978:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850883.072985:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000093fd6d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6561:x1875746019609216:12345-0@lo:502: 00000100:00100000:2.0:1788850883.073115:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000093fd6d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6561:x1875746019609216:12345-0@lo:502: Request processed in 130us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850883.073122:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850883.073154:0:6561:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c76b8779 going to sleep for 11 seconds 00000100:00100000:2.0:1788850883.073167:0:6561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:6561:1875746019609216:0@lo:502: 00000040:00080000:2.0:1788850883.073189:0:6561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788850883.073333:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788850883.073357:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788850883.073377:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.073388:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788850883.073433:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788850883.073435:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788850883.073437:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850883.073438:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850883.073440:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850883.073441:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850883.073442:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788850883.073443:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788850883.073445:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850883.073446:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850883.073448:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850883.073450:0:6511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788850883.073453:0:6511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788850883.073455:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788850883.073457:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788850883.073458:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850883.073459:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850883.073460:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850883.073461:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850883.073462:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788850883.073463:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788850883.073464:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850883.073465:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850883.073466:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850883.073467:0:6511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788850883.073478:0:6511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788850883.073486:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000349f947a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019609344:0@lo:253: 00000100:00100000:0.0:1788850883.073520:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850883.073546:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a67d15a going to sleep for 11 seconds 00000100:00100000:2.0:1788850883.073622:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609344 00000100:00100000:2.0:1788850883.073627:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609344 00000100:00100000:2.0:1788850883.073721:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788850883.073728:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ec6fcdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6511:x1875746019609344:12345-0@lo:253: 20000000:01000000:2.0:1788850883.073747:0:6529:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788850883.073759:0:6529:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788850883.081073:0:6529:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788850883.081090:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788850883.081215:0:6550:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788850883.081221:0:6550:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788850883.081242:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.081261:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2054c8 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.081267:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.081314:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2054c8 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.081327:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2054c8 expref: 12 pid: 6529 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850883.081341:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019609472:0@lo:104: 00000100:00100000:2.0:1788850883.081405:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850883.081458:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055ef1b8e going to sleep for 11 seconds 00000100:00100000:3.0:1788850883.081510:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609472 00000100:00100000:3.0:1788850883.081518:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609472 00000100:00100000:3.0:1788850883.081567:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850883.081574:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb6b73bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6550:x1875746019609472:12345-0@lo:104: 00010000:00010000:3.0:1788850883.081586:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.081648:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788850883.081653:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb6b73bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6550:x1875746019609472:12345-0@lo:104: Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850883.081670:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788850883.081803:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788850883.081809:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850883.081816:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e45e217 already unused, calling callback (00000000654d1d4b) 10000000:00010000:1.0:1788850883.081820:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850883.081827:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850883.081833:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850883.081838:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850883.081910:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850883.081917:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788850883.081932:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850883.081937:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 000000006e45e217/0x3e0030720b2054c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2054cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850883.081941:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019609472:0@lo:104: 00010000:00010000:1.0:1788850883.081952:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850883.081954:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850883.081955:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850883.081959:0:6550:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850883.082081:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788850883.082095:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019609600:0@lo:103: 00000100:00100000:1.0:1788850883.082126:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850883.082580:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609600 00000100:00100000:2.0:1788850883.082586:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609600 00010000:00010000:2.0:1788850883.082607:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2054c8 expref: 13 pid: 6529 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850883.082639:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850883.082645:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d7c4c81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:3647:x1875746019609600:12345-0@lo:103: 00010000:00010000:2.0:1788850883.082667:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850883.082671:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2054c8 expref: 13 pid: 6529 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082680:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2054c8 expref: 13 pid: 6529 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082691:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab535c36/0x3e0030720b2054cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2054c8 expref: 13 pid: 6529 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082705:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082722:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788850883.082735:0:6519:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001514909s 00010000:00010000:2.0:1788850883.082739:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082745:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082750:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082756:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082766:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000043defdd5 already unused, calling callback (00000000a093a272) 00010000:00010000:2.0:1788850883.082770:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082786:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082799:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082808:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850883.082864:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d7c4c81 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:3647:x1875746019609600:12345-0@lo:103: Request processed in 220us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850883.082871:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850883.082904:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb170587 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019609600:0@lo:103: 00010000:00010000:2.0:1788850883.082920:0:6550:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082928:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.082933:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000043defdd5/0x3e0030720b205500 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850883.086562:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ec6fcdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:6511:x1875746019609344:12345-0@lo:253: Request processed in 12829us (13036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850883.086578:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788850883.087357:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000349f947a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:6511:1875746019609344:0@lo:253: 10000000:01000000:0.0:1788850883.087373:0:6511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788850883.087376:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788850883.087378:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788850883.087379:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850883.087381:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850883.087382:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850883.087383:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850883.087384:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788850883.087386:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788850883.087387:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850883.087389:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850883.087390:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850883.087391:0:6511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788850883.087403:0:6511:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788850883.101603:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788850883.102580:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788850883.104461:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788850883.104653:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788850883.106242:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788850883.107186:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788850883.108672:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788850883.108858:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788850883.109418:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788850883.109575:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788850883.110343:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788850883.110506:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788850883.126493:0:6511:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788850883.148578:0:6511:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788850883.149313:0:6566:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788850883.149318:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788850883.149690:0:6567:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788850883.151441:0:6511:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788850883.151549:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788850883.154095:0:6511:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788850883.154133:0:6511:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788850883.154383:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850883.159853:0:6511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788850883.160588:0:6511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788850883.160627:0:6511:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788850883.160854:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788850883.161103:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788850883.161753:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788850883.161892:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788850883.162090:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788850883.163816:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788850883.164588:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788850883.164915:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788850883.165405:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788850883.165547:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788850883.165755:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788850883.165941:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788850883.166936:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788850883.167267:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788850883.167409:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788850883.167539:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788850883.167813:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788850883.168305:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788850883.168796:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000040:00080000:3.0:1788850883.169047:0:6567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1788850883.169599:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788850883.177501:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788850883.178550:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788850883.178802:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788850883.178960:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788850883.179152:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788850883.179291:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788850883.179493:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788850883.179660:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788850883.179815:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788850883.179949:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788850883.180126:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788850883.180272:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788850883.180397:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788850883.180548:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788850883.181226:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788850883.185213:0:6567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788850883.185304:0:6567:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788850883.185309:0:6567:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1788850883.190280:0:6511:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788850883.190327:0:6511:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa99041c37988 00100000:10000000:1.0:1788850883.190343:0:6511:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788850883.191087:0:6511:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788850883.191103:0:6511:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788850883.191124:0:6511:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788850883.191139:0:6511:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788850883.194318:0:6511:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788850883.194515:0:6511:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788850883.764512:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850884.800505:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850885.817786:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850886.840679:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850887.665708:0:6812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788850887.866794:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788850888.117121:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788850888.117133:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788850888.117136:0:37:0:(import.c:65:import_set_state_nolock()) 000000005dbb1121 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788850888.117163:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005dbb1121 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788850888.117198:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850888.117216:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000349f947a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019609728:0@lo:400: 00000100:00100000:1.0:1788850888.117290:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850888.117385:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609728 00000100:00100000:0.0:1788850888.117394:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609728 00000100:00100000:0.0:1788850888.117454:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788850888.117456:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cb050a84 x1875746019609856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788850888.117467:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d126e6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:3650:x1875746019609728:12345-0@lo:400: 00000100:00100000:3.0:1788850888.117497:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019609856:0@lo:38: 00000100:00100000:3.0:1788850888.117539:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850888.117549:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d126e6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:3650:x1875746019609728:12345-0@lo:400: Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850888.117557:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788850888.117584:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609856 00000100:00100000:3.0:1788850888.117589:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609856 00000100:00100000:0.0:1788850888.117612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000349f947a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019609728:0@lo:400: 00000100:00100000:3.0:1788850888.117618:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788850888.117625:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000637e4102 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019609856:12345-0@lo:38: 00010000:00080000:3.0:1788850888.117648:0:6536:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:3.0:1788850888.117702:0:6536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e0030720b205507 00000004:00100000:3.0:1788850888.117748:0:6536:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788850888.117873:0:6536:0:(import.c:65:import_set_state_nolock()) 000000003a4fc97a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850888.117923:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000637e4102 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875746019609856:12345-0@lo:38: Request processed in 298us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850888.117931:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788850888.118170:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cb050a84 x1875746019609856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788850898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788850888.118193:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788850888.118201:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788850888.118205:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788850888.118207:0:3646:0:(import.c:65:import_set_state_nolock()) 000000005dbb1121 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788850888.118212:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb050a84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019609856:0@lo:38: 00000020:00000004:1.0:1788850888.536575:0:6864:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788850888.537567:0:6864:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788850888.884749:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850889.909392:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788850890.677148:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788850890.677156:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e91596800 from 3 10000000:01000000:3.0:1788850890.677161:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788850890.677205:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850890.677218:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850890.677229:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850890.677252:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019609984:0@lo:101: 00000100:00100000:3.0:1788850890.677316:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850890.677507:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013419fa3 going to sleep for 11 seconds 00000100:00100000:2.0:1788850890.681221:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609984 00000100:00100000:2.0:1788850890.681237:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609984 00000100:00100000:2.0:1788850890.690098:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850890.690120:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b2abb962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:6531:x1875746019609984:12345-0@lo:101: 00010000:00010000:2.0:1788850890.690140:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850890.690158:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20550e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850890.690199:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20550e expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850890.690209:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20550e expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850890.690218:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000483e4ed2, rc 0) 00000100:00100000:2.0:1788850890.690298:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b2abb962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6531:x1875746019609984:12345-0@lo:101: Request processed in 190us (12982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850890.690306:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788850890.690458:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019609984:0@lo:101: 00010000:00010000:3.0:1788850890.690476:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850890.690485:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850890.690552:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019610112:0@lo:256: 00000100:00100000:3.0:1788850890.690592:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850890.690647:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013419fa3 going to sleep for 11 seconds 00000100:00100000:0.0:1788850890.690723:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610112 00000100:00100000:0.0:1788850890.690730:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610112 00000100:00100000:0.0:1788850890.690837:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788850890.690844:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0ca64f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6531:x1875746019610112:12345-0@lo:256: 20000000:01000000:0.0:1788850890.690858:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788850890.690874:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788850890.690876:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788850890.690981:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0ca64f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:6531:x1875746019610112:12345-0@lo:256: Request processed in 138us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850890.690995:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788850890.697037:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019610112:0@lo:256: 10000000:01000000:3.0:1788850890.697114:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788850890.697124:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850890.697135:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850890.933155:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788850891.113710:0:6965:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788850891.114009:0:6965:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788850891.961277:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850892.984804:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850893.236241:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060cfb98e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019610368:0@lo:400: 00000100:00100000:2.0:1788850893.236309:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850893.236378:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610368 00000100:00100000:2.0:1788850893.236385:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610368 00000100:00100000:2.0:1788850893.236428:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850893.236436:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012308c2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019610368:12345-0@lo:400: 00000100:00100000:2.0:1788850893.236486:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012308c2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019610368:12345-0@lo:400: Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850893.236492:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788850893.236540:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000060cfb98e x1875746019610368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850893.236554:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060cfb98e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019610368:0@lo:400: 00000100:00100000:0.0:1788850893.236663:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014df1c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019610240:0@lo:400: 00000100:00100000:0.0:1788850893.236699:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850893.236779:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610240 00000100:00100000:2.0:1788850893.236784:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610240 00000100:00100000:2.0:1788850893.236820:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788850893.236827:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008aa28162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:3650:x1875746019610240:12345-0@lo:400: 00000100:00100000:2.0:1788850893.236885:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008aa28162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:3650:x1875746019610240:12345-0@lo:400: Request processed in 60us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850893.236891:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788850893.237104:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014df1c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019610240:0@lo:400: 00010000:00010000:3.0:1788850894.004147:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850895.041327:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850896.053133:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850897.077866:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850898.107188:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850898.356854:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000349f947a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019610496:0@lo:400: 00000100:00100000:0.0:1788850898.356926:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850898.357007:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000496b6b11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019610624:0@lo:400: 00000100:00100000:0.0:1788850898.357054:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850898.357091:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610496 00000100:00100000:0.0:1788850898.357098:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610496 00000100:00100000:0.0:1788850898.357137:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788850898.357144:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a45ef971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:3648:x1875746019610496:12345-0@lo:400: 00000100:00100000:0.0:1788850898.357188:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a45ef971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:3648:x1875746019610496:12345-0@lo:400: Request processed in 44us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850898.357194:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788850898.357234:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000349f947a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019610496:0@lo:400: 00000100:00100000:2.0:1788850898.360282:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610624 00000100:00100000:2.0:1788850898.360295:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610624 00000100:00100000:2.0:1788850898.360369:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850898.360378:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000342a7f2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019610624:12345-0@lo:400: 00000100:00100000:2.0:1788850898.360464:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000342a7f2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019610624:12345-0@lo:400: Request processed in 87us (3409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850898.360472:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788850898.360519:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000496b6b11 x1875746019610624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850898.360534:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000496b6b11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019610624:0@lo:400: 00010000:00010000:0.0:1788850899.126439:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850900.148300:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788850900.450834:0:7464:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788850900.450838:0:7464:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788850900.450840:0:7464:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788850900.451205:0:7464:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002d0d2641 00000020:01000004:3.0:1788850900.451237:0:7464:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788850900.451251:0:7464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788850900.451274:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000004dcd2d87) 00000020:00000080:3.0:1788850900.451290:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788850900.504335:0:7464:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788850900.504520:0:7464:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788850900.521837:0:7464:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788850900.522306:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788850900.522317:0:7464:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788850900.522329:0:7464:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b205523 00000020:01000004:0.0:1788850900.522337:0:7464:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788850900.522357:0:7464:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788850900.522360:0:7464:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788850900.522371:0:7464:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788850900.522410:0:7464:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788850900.522416:0:7464:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788850900.553812:0:7464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788850900.553858:0:7464:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788850900.553863:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788850900.553865:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788850900.553867:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850900.553868:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850900.553870:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850900.553871:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850900.553872:0:7464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788850900.553874:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850900.553875:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850900.553877:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850900.553878:0:7464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788850900.553881:0:7464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788850900.553884:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788850900.553886:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788850900.553887:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850900.553888:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850900.553889:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850900.553895:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850900.553896:0:7464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788850900.553897:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850900.553898:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850900.553898:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850900.553899:0:7464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788850900.553926:0:7464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788850900.553944:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046614be8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019610752:0@lo:253: 00000100:00100000:1.0:1788850900.554032:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850900.554075:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3a44fe4 going to sleep for 11 seconds 00000100:00100000:0.0:1788850900.554079:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610752 00000100:00100000:0.0:1788850900.554087:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610752 00000100:00100000:0.0:1788850900.554137:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788850900.554145:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000e4955f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019610752:12345-0@lo:253: 20000000:01000000:0.0:1788850900.554176:0:6526:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788850900.554180:0:6526:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788850900.554184:0:6526:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788850900.554187:0:6526:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788850900.554226:0:6526:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788850900.554454:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850900.554597:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788850900.554612:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788850900.554650:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788850900.554674:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788850900.554689:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788850900.555099:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788850900.555110:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788850900.555125:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788850900.555132:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788850900.555144:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788850900.555149:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788850900.555161:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788850900.555175:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788850900.555273:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788850900.555282:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1788850900.555294:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788850900.555299:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788850900.555310:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788850900.555326:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1788850900.555341:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788850900.555347:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788850900.555359:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788850900.555374:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788850900.555383:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788850900.555850:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788850900.555862:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788850900.555876:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788850900.555891:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788850900.555906:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788850900.555911:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788850900.555987:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788850900.556036:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788850900.556044:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788850900.556075:0:6526:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788850900.556083:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788850900.556769:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788850900.561262:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788850900.561296:0:6526:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.127@tcp for mdt 20000000:01000000:0.0:1788850900.561299:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1788850900.561650:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788850900.561660:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788850900.561680:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788850900.561686:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1788850900.561717:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788850900.561727:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788850900.561743:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788850900.561759:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788850900.561817:0:6526:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788850900.561827:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788850900.565440:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788850900.567594:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788850900.567634:0:6526:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.127@tcp for mdt 20000000:01000000:0.0:1788850900.567636:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1788850900.567658:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788850900.567664:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788850900.567677:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788850900.567681:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1788850900.567692:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788850900.567700:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788850900.567726:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788850900.567766:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788850900.567792:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788850900.567795:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788850900.567799:0:6526:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788850900.567960:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788850900.567963:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788850900.569383:0:7472:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788850900.569420:0:7472:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788850900.569436:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788850900.569738:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788850900.569767:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788850900.569783:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788850900.569793:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788850900.569795:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788850900.575302:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788850900.575469:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788850900.575486:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1788850900.575810:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788850900.575836:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788850900.575854:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1788850900.575868:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788850900.575871:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788850900.577188:0:7474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788850900.577225:0:7474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788850900.577241:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788850900.577518:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788850900.577539:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788850900.577563:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788850900.577685:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788850900.577689:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788850900.577695:0:6526:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788850900.577711:0:6526:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788850900.582607:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788850900.582731:0:6526:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788850900.593195:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788850900.593740:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.593761:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205458 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.593767:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205474 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.593775:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2054e4 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.593782:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.593822:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2054e4 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.593845:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2054e4 expref: 12 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850900.593859:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000349f947a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875746019610880:0@lo:104: 00000100:00100000:0.0:1788850900.593931:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850900.593989:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205474 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.594002:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205474 expref: 12 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850900.594027:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000766dbe0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875746019611008:0@lo:104: 00000100:00100000:0.0:1788850900.594049:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850900.594077:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205458 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.594085:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205458 expref: 12 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850900.594092:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000043ee78a2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875746019611136:0@lo:104: 00000100:00100000:0.0:1788850900.594110:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850900.594118:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7989b8a going to sleep for 11 seconds 00000100:00100000:3.0:1788850900.594504:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610880 00000100:00100000:3.0:1788850900.594513:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610880 00000100:00100000:2.0:1788850900.594779:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611008 00000100:00100000:2.0:1788850900.594784:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611008 00000100:00100000:3.0:1788850900.594924:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611136 00000100:00100000:3.0:1788850900.594928:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611136 00000100:00100000:2.0:1788850900.595120:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850900.595127:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6818522 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:6526:x1875746019610880:12345-0@lo:104: 00010000:00010000:2.0:1788850900.595139:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.595238:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788850900.595242:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6818522 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:6526:x1875746019610880:12345-0@lo:104: Request processed in 117us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.595249:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850900.595266:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788850900.595271:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004bd20da5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6526:x1875746019611008:12345-0@lo:104: 00010000:00010000:2.0:1788850900.595277:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.595305:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788850900.595309:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004bd20da5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6526:x1875746019611008:12345-0@lo:104: Request processed in 39us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.595314:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850900.595418:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000349f947a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875746019610880:0@lo:104: 00000100:00100000:0.0:1788850900.595425:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000766dbe0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875746019611008:0@lo:104: 00000100:00100000:3.0:1788850900.595645:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850900.595652:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d5f09d74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6526:x1875746019611136:12345-0@lo:104: 00010000:00010000:3.0:1788850900.595662:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.596081:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788850900.596086:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.596105:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c426aeb3 already unused, calling callback (00000000654d1d4b) 10000000:00010000:0.0:1788850900.596108:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.596115:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850900.596121:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850900.596126:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850900.596188:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.596195:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850900.596210:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.596216:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000c426aeb3/0x3e0030720b2054e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2054eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.596226:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850900.596228:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.596233:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068b55c40 already unused, calling callback (00000000654d1d4b) 10000000:00010000:0.0:1788850900.596235:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.596249:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850900.596255:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850900.596260:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788850900.597172:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788850900.597180:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d5f09d74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6526:x1875746019611136:12345-0@lo:104: Request processed in 1529us (3069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850900.597189:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850900.597427:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850900.597440:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006da30d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019611264:0@lo:103: 00000100:00100000:2.0:1788850900.597477:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850900.597731:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.597740:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850900.597752:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.597758:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 0000000068b55c40/0x3e0030720b205474 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20547b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.597770:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850900.597772:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.597777:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e9dc1c8 already unused, calling callback (00000000654d1d4b) 10000000:00010000:0.0:1788850900.597779:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.597785:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850900.597790:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850900.597806:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850900.597874:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850900.598497:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.598507:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850900.598513:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.598519:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 000000006e9dc1c8/0x3e0030720b205458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20545f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.598550:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850900.598552:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850900.598553:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850900.598570:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a105b68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019611392:0@lo:103: 00000100:00100000:0.0:1788850900.598625:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850900.598665:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611264 00000100:00100000:0.0:1788850900.598670:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788850900.598674:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611264 00000100:00100000:0.0:1788850900.598679:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067c80e86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019611520:0@lo:103: 00010000:00010000:1.0:1788850900.598717:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2054e4 expref: 13 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850900.598718:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850900.598757:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611392 00000100:00100000:0.0:1788850900.598762:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611392 00010000:00010000:0.0:1788850900.598778:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205474 expref: 14 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850900.598795:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611520 00000100:00100000:0.0:1788850900.598798:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611520 00010000:00010000:0.0:1788850900.598808:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205458 expref: 15 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850900.598832:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850900.598839:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b731b1bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:3647:x1875746019611392:12345-0@lo:103: 00010000:00010000:0.0:1788850900.598851:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850900.598855:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205474 expref: 15 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.598863:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205474 expref: 15 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.598887:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000004d7638f/0x3e0030720b20547b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205474 expref: 15 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.598900:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850900.598931:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b731b1bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:3647:x1875746019611392:12345-0@lo:103: Request processed in 94us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850900.598938:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850900.598953:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850900.598958:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078157995 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:3647:x1875746019611520:12345-0@lo:103: 00010000:00010000:0.0:1788850900.598964:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850900.598969:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205458 expref: 13 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.598987:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205458 expref: 13 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850900.598996:0:6520:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1788850900.598998:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850900.599004:0:6520:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788850900.599082:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078157995 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:3647:x1875746019611520:12345-0@lo:103: Request processed in 124us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850900.599097:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850900.599109:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788850900.599115:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060cfb98e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:3649:x1875746019611264:12345-0@lo:103: 00010000:00010000:0.0:1788850900.599122:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850900.599126:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2054e4 expref: 12 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.599136:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2054e4 expref: 12 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.599146:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000034d85f67/0x3e0030720b2054eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2054e4 expref: 12 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.599157:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.599165:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.599179:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850900.599180:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067c80e86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019611520:0@lo:103: 00010000:00010000:0.0:1788850900.599192:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850900.599196:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a105b68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019611392:0@lo:103: 00010000:00010000:0.0:1788850900.599208:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.599214:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.599230:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000402bb0ed/0x3e0030720b20545f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205458 expref: 11 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.599230:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009470b7c4 already unused, calling callback (00000000a093a272) 00010000:00010000:0.0:1788850900.599236:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850900.599249:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000043ee78a2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875746019611136:0@lo:104: 00010000:00010000:0.0:1788850900.599250:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.599264:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.599274:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850900.599310:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060cfb98e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+10:3649:x1875746019611264:12345-0@lo:103: Request processed in 196us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.599337:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006da30d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019611264:0@lo:103: 00010000:00010000:1.0:1788850900.599344:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.599356:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.599363:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.599369:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009470b7c4/0x3e0030720b20552a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788850900.599385:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788850900.599523:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788850900.605003:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000e4955f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:7464:x1875746019610752:12345-0@lo:253: Request processed in 50850us (50962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.605053:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788850900.605326:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046614be8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019610752:0@lo:253: 10000000:01000000:2.0:1788850900.605344:0:7464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788850900.605348:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788850900.605350:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788850900.605351:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788850900.605368:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788850900.605369:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788850900.605371:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788850900.605372:0:7464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788850900.605373:0:7464:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788850900.605375:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788850900.605377:0:7464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788850900.605396:0:7464:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002d0d2641 from lustre-MDT0001 10000000:01000000:2.0:1788850900.605427:0:7464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788850900.605430:0:7464:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788850900.605446:0:7464:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff892ebbbc99c0 local copy 10000000:01000000:2.0:1788850900.605450:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788850900.605484:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.605495:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.605505:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850900.605627:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065b0b02c pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019611648:0@lo:101: 00000100:00100000:2.0:1788850900.605667:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850900.605742:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611648 00000100:00100000:2.0:1788850900.605743:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 0000000095b3a601 going to sleep for 11 seconds 00000100:00100000:0.0:1788850900.605749:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611648 00000100:00100000:0.0:1788850900.605790:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788850900.605798:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022cdf23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:7464:x1875746019611648:12345-0@lo:101: 00010000:00010000:0.0:1788850900.605811:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850900.605823:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034d85f67/0x3e0030720b205538 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205531 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.605845:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034d85f67/0x3e0030720b205538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205531 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.605855:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034d85f67/0x3e0030720b205538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205531 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.605864:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034d85f67, rc 0) 00000100:00100000:2.0:1788850900.606150:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065b0b02c pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019611648:0@lo:101: 00010000:00010000:2.0:1788850900.606164:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.606173:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850900.606193:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022cdf23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+10:7464:x1875746019611648:12345-0@lo:101: Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850900.606200:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788850900.606319:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019611776:0@lo:501: 00000100:00100000:3.0:1788850900.606351:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.606381:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6be356e going to sleep for 11 seconds 00000100:00100000:1.0:1788850900.606443:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611776 00000100:00100000:1.0:1788850900.606448:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611776 00000100:00100000:2.0:1788850900.606752:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788850900.606762:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d10788 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+10:7464:x1875746019611776:12345-0@lo:501: 00000100:00100000:2.0:1788850900.606838:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d10788 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+10:7464:x1875746019611776:12345-0@lo:501: Request processed in 78us (486us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788850900.606844:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788850900.606927:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019611776:0@lo:501: 10000000:01000000:3.0:1788850900.606940:0:7464:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788850900.606958:0:7464:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788850900.606963:0:7464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.606971:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.606977:0:7464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.606999:0:7464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788850900.607045:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892ebbbf6000 10000000:01000000:3.0:1788850900.607049:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788850900.607053:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff892ebbbc99c0 10000000:01000000:3.0:1788850900.607055:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788850900.607058:0:7464:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff892ebbbc99c0 from 1 10000000:01000000:3.0:1788850900.607060:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788850900.607077:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000e2157e7b/0x3e0030720b20553f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.607088:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000e2157e7b/0x3e0030720b20553f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.607096:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000e2157e7b/0x3e0030720b20553f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.607106:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019611904:0@lo:101: 00000100:00100000:3.0:1788850900.607130:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.607156:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d837 going to sleep for 11 seconds 00000100:00100000:0.0:1788850900.607212:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611904 00000100:00100000:0.0:1788850900.607216:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611904 00000100:00100000:0.0:1788850900.607276:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788850900.607282:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f897308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+10:7464:x1875746019611904:12345-0@lo:101: 00010000:00010000:0.0:1788850900.607288:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850900.607296:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e9dc1c8/0x3e0030720b205546 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20553f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.607309:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e9dc1c8/0x3e0030720b205546 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20553f expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.607327:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e9dc1c8/0x3e0030720b205546 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20553f expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.607334:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e9dc1c8, rc 0) 00000100:00100000:0.0:1788850900.607363:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f897308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:7464:x1875746019611904:12345-0@lo:101: Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850900.607369:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788850900.607425:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788850900.607431:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.607447:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000892de194 already unused, calling callback (00000000654d1d4b) 10000000:00010000:1.0:1788850900.607450:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.607473:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850900.607480:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850900.607485:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850900.607504:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.607509:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788850900.607529:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.607535:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000892de194/0x3e0030720b205531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e0030720b205538 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.607907:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850900.607909:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850900.607910:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850900.608480:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019611904:0@lo:101: 00010000:00010000:3.0:1788850900.608497:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000e2157e7b/0x3e0030720b20553f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205546 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.608506:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000e2157e7b/0x3e0030720b20553f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205546 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850900.608526:0:7464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788850900.608543:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000e2157e7b/0x3e0030720b20553f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205546 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.608553:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000e2157e7b/0x3e0030720b20553f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205546 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850900.608563:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff892ebbbf6000 10000000:01000000:3.0:1788850900.608569:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788850900.608574:0:7464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff892ebbbf6000 from 1 10000000:01000000:3.0:1788850900.608576:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788850900.608597:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000721fcc6b/0x3e0030720b20554d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.608613:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000721fcc6b/0x3e0030720b20554d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.608621:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000721fcc6b/0x3e0030720b20554d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.608637:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612160:0@lo:101: 00000100:00100000:3.0:1788850900.608686:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850900.609253:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850900.609268:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004630c57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019612032:0@lo:103: 00000100:00100000:1.0:1788850900.609305:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850900.610211:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612160 00000100:00100000:2.0:1788850900.610221:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612160 00000100:00100000:3.0:1788850900.610237:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d837 going to sleep for 11 seconds 00000100:00100000:3.0:1788850900.610269:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612032 00000100:00100000:3.0:1788850900.610274:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612032 00000100:00100000:3.0:1788850900.610328:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788850900.610337:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788850900.610341:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d1d3ac49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:3650:x1875746019612032:12345-0@lo:103: 00000100:00100000:1.0:1788850900.610353:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a6e7c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612160:12345-0@lo:101: 00010000:00010000:3.0:1788850900.610374:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850900.610378:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850900.610393:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000034d85f67/0x3e0030720b205538 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205531 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.610393:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068b55c40/0x3e0030720b205554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20554d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.610422:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788850900.610429:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068b55c40/0x3e0030720b205554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20554d expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.610440:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068b55c40/0x3e0030720b205554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20554d expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.610447:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068b55c40, rc 0) 00000100:00100000:3.0:1788850900.610480:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d1d3ac49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:3650:x1875746019612032:12345-0@lo:103: Request processed in 144us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850900.610488:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850900.610521:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004630c57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019612032:0@lo:103: 00000100:00100000:1.0:1788850900.611256:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a6e7c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:7464:x1875746019612160:12345-0@lo:101: Request processed in 906us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.611264:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788850900.612910:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612160:0@lo:101: 00010000:00010000:3.0:1788850900.612936:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000721fcc6b/0x3e0030720b20554d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.612947:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000721fcc6b/0x3e0030720b20554d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850900.612985:0:7464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788850900.612999:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000721fcc6b/0x3e0030720b20554d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.613007:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000721fcc6b/0x3e0030720b20554d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850900.613036:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788850900.613041:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788850900.613047:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff892ebbbf6000 10000000:01000000:3.0:1788850900.613049:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788850900.613053:0:7464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788850900.613055:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788850900.613085:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000000423e2b/0x3e0030720b20555b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.613092:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000000423e2b/0x3e0030720b20555b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.613100:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000000423e2b/0x3e0030720b20555b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.613118:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612288:0@lo:101: 00000100:00100000:3.0:1788850900.613169:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.613217:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d837 going to sleep for 11 seconds 00000100:00100000:2.0:1788850900.613295:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612288 00000100:00100000:2.0:1788850900.613302:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612288 00000100:00100000:2.0:1788850900.613422:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788850900.613430:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002315a84b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+11:7464:x1875746019612288:12345-0@lo:101: 00010000:00010000:2.0:1788850900.613441:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850900.613522:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043defdd5/0x3e0030720b205562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20555b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.613542:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043defdd5/0x3e0030720b205562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20555b expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.613551:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043defdd5/0x3e0030720b205562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20555b expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.613558:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043defdd5, rc 0) 00000100:00100000:2.0:1788850900.613729:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002315a84b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612288:12345-0@lo:101: Request processed in 300us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.613737:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788850900.616125:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612288:0@lo:101: 00010000:00010000:3.0:1788850900.616153:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000000423e2b/0x3e0030720b20555b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.616186:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000000423e2b/0x3e0030720b20555b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.616311:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612416:0@lo:501: 00000100:00100000:3.0:1788850900.616370:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.616421:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d837 going to sleep for 11 seconds 00000100:00100000:2.0:1788850900.616421:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612416 00000100:00100000:2.0:1788850900.616428:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612416 00000100:00100000:2.0:1788850900.616472:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788850900.616480:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f45723c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612416:12345-0@lo:501: 00000100:00100000:2.0:1788850900.616616:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f45723c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612416:12345-0@lo:501: Request processed in 137us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.616624:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788850900.616758:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612416:0@lo:501: 00000100:00100000:3.0:1788850900.616787:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612544:0@lo:503: 00000100:00100000:3.0:1788850900.616826:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.616839:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d837 going to sleep for 11 seconds 00000100:00100000:0.0:1788850900.616972:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612544 00000100:00100000:0.0:1788850900.616977:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612544 00000100:00100000:0.0:1788850900.617029:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788850900.617037:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1af2fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612544:12345-0@lo:503: 00000100:00100000:0.0:1788850900.617123:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1af2fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612544:12345-0@lo:503: Request processed in 87us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850900.617129:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788850900.617141:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612544:0@lo:503: 00000040:00080000:3.0:1788850900.617633:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788850900.617698:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612672:0@lo:502: 00000100:00100000:3.0:1788850900.617749:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.617770:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d837 going to sleep for 11 seconds 00000100:00100000:2.0:1788850900.617828:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612672 00000100:00100000:2.0:1788850900.617833:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612672 00000100:00100000:2.0:1788850900.617875:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850900.617881:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073e590b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612672:12345-0@lo:502: 00000100:00100000:2.0:1788850900.617956:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073e590b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612672:12345-0@lo:502: Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.617963:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788850900.618133:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612672:0@lo:502: 00000040:00080000:3.0:1788850900.618302:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788850900.618612:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788850900.618630:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788850900.618643:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788850900.618658:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788850900.618671:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788850900.618683:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788850900.618696:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788850900.618724:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788850900.618738:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788850900.618762:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788850900.618775:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788850900.618787:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788850900.618799:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788850900.618812:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788850900.618824:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788850900.618837:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788850900.618852:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788850900.618912:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788850900.618929:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788850900.618941:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788850900.618953:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788850900.618964:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788850900.618985:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612800:0@lo:502: 00000100:00100000:3.0:1788850900.619056:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.619078:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d837 going to sleep for 11 seconds 00000100:00100000:0.0:1788850900.619730:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612800 00000100:00100000:0.0:1788850900.619745:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612800 00000100:00100000:0.0:1788850900.619792:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788850900.619798:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b567b8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612800:12345-0@lo:502: 00000100:00100000:0.0:1788850900.620283:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b567b8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019612800:12345-0@lo:502: Request processed in 484us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850900.620291:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788850900.620436:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df529f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019612800:0@lo:502: 00000040:00080000:3.0:1788850900.620510:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788850900.620520:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788850900.620990:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850900.621000:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850900.621003:0:7477:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788850900.621034:0:7477:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788850900.621038:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788850900.621058:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000000b17208) 00000020:00000080:2.0:1788850900.621077:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788850900.621083:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788850900.621162:0:7477:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788850900.621169:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b205570 00000020:00000080:2.0:1788850900.621396:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788850900.621402:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850900.621405:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850900.621406:0:7477:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788850900.621409:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850900.621412:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850900.621413:0:7477:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788850900.621416:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788850900.621422:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000d04cd202) 00000020:00000080:2.0:1788850900.621432:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788850900.621442:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788850900.621444:0:7477:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788850900.621446:0:7477:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788850900.621573:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788850900.621621:0:7477:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002d0d2641 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788850900.621634:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000002e109c1e) 00000020:00000080:2.0:1788850900.621643:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788850900.621739:0:7477:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788850900.621745:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b205585 00000020:00000080:2.0:1788850900.621849:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788850900.621855:0:7477:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788850900.621860:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x3e0030720b20558c 00080000:01000000:2.0:1788850900.621865:0:7477:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788850900.621868:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b205593 00080000:10000000:2.0:1788850900.622307:0:7477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788850900.622691:0:7477:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788850900.744198:0:7477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788850900.744439:0:7477:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788850900.747850:0:7477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788850900.748321:0:7477:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788850900.765689:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788850900.765715:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850900.765722:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850900.765724:0:7477:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788850900.765728:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850900.765734:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850900.765735:0:7477:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788850900.765738:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788850900.765743:0:7477:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:1.0:1788850900.765785:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788850900.765801:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000002762828c) 00000020:00000080:1.0:1788850900.765821:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788850900.765826:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788850900.765908:0:7477:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788850900.765915:0:7477:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788850900.765921:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b2055a1 00010000:00080000:1.0:1788850900.765950:0:7477:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003359e49f@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1788850900.768281:0:7477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788850900.776722:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788850900.776738:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788850900.776778:0:7477:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788850900.776799:0:7477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b2055a8 00000100:00080000:0.0:1788850900.776810:0:7477:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788850900.776821:0:7477:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000003359e49f using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788850900.776855:0:7477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e732b7d6 x1875746019612928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788850900.776881:0:7477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788850900.776961:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e732b7d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019612928:0@lo:38: 00000100:00100000:3.0:1788850900.777072:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.777139:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612928 00000100:00100000:3.0:1788850900.777146:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612928 00000100:00100000:3.0:1788850900.777176:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850900.777182:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062df529f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019612928:12345-0@lo:38: 00010000:00080000:3.0:1788850900.777205:0:6539:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1788850900.777235:0:6539:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b2055af 00000004:00100000:3.0:1788850900.777248:0:6539:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788850900.777254:0:6539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1788850900.777439:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850900.777445:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850900.777446:0:7477:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788850900.777461:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788850900.777464:0:7477:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788850900.777465:0:7477:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788850900.777466:0:7477:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788850900.777468:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788850900.777470:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850900.777472:0:7477:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788850900.777473:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850900.777478:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850900.777479:0:7477:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788850900.777482:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788850900.777512:0:7477:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788850900.777524:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850900.777534:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850900.777535:0:7477:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788850900.777538:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850900.777540:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850900.777541:0:7477:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788850900.777543:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788850900.777545:0:7477:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788850900.777567:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850900.777571:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850900.777572:0:7477:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788850900.777575:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1788850900.777913:0:7464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788850900.777943:0:7464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788850900.777965:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000000423e2b/0x3e0030720b20555b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.777977:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000000423e2b/0x3e0030720b20555b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850900.777986:0:7464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892ebbbf6000 from 1 10000000:01000000:3.0:1788850900.777988:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788850900.778060:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.778068:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.778077:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.778092:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613056:0@lo:101: 00000100:00100000:3.0:1788850900.778132:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.778154:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c76b8779 going to sleep for 11 seconds 00000100:00100000:0.0:1788850900.778305:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613056 00000100:00100000:0.0:1788850900.778310:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613056 00000100:00100000:0.0:1788850900.778348:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788850900.778354:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008d6a61d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+12:7464:x1875746019613056:12345-0@lo:101: 00010000:00010000:0.0:1788850900.778365:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850900.778390:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2055b6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.778412:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2055b6 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.778421:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2055b6 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.778429:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c426aeb3, rc 0) 00000100:00100000:0.0:1788850900.778618:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008d6a61d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:7464:x1875746019613056:12345-0@lo:101: Request processed in 263us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850900.778625:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788850900.778855:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613056:0@lo:101: 00010000:00010000:3.0:1788850900.778868:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.778877:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.779772:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613184:0@lo:256: 00000100:00100000:1.0:1788850900.781042:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa5f9e5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019613312:0@lo:400: 00000100:00100000:1.0:1788850900.781146:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850900.781217:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613312 00000100:00100000:1.0:1788850900.781224:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613312 00000100:00100000:1.0:1788850900.781261:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788850900.781267:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d1abea50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019613312:12345-0@lo:400: 00000100:00100000:1.0:1788850900.781310:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d1abea50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019613312:12345-0@lo:400: Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.781317:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788850900.781350:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000aa5f9e5a x1875746019613312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850900.781361:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa5f9e5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019613312:0@lo:400: 00000100:00100000:3.0:1788850900.781552:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.781580:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c76b8779 going to sleep for 11 seconds 00000100:00100000:1.0:1788850900.781811:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613184 00000100:00100000:1.0:1788850900.781816:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613184 00000100:00100000:1.0:1788850900.781849:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788850900.781856:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000204248e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:7464:x1875746019613184:12345-0@lo:256: 20000000:01000000:1.0:1788850900.781872:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788850900.781889:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788850900.781892:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788850900.781984:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000204248e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:7464:x1875746019613184:12345-0@lo:256: Request processed in 129us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.781991:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788850900.782191:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613184:0@lo:256: 10000000:01000000:3.0:1788850900.782995:0:7464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788850900.783043:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.783054:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850900.783062:0:7464:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ebbbf6000 from 1 10000000:01000000:3.0:1788850900.783064:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788850900.783092:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.783098:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.783106:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.783122:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613440:0@lo:101: 00000100:00100000:3.0:1788850900.783161:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.783187:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c76b8779 going to sleep for 11 seconds 00000100:00100000:1.0:1788850900.783420:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613440 00000100:00100000:1.0:1788850900.783427:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613440 00000100:00100000:1.0:1788850900.783661:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788850900.783669:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004856923b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:7464:x1875746019613440:12345-0@lo:101: 00010000:00010000:1.0:1788850900.783691:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850900.783713:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2055c4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.783735:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2055c4 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.783744:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2055c4 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.783752:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000056d7e91f, rc 0) 00000100:00100000:1.0:1788850900.783787:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004856923b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:7464:x1875746019613440:12345-0@lo:101: Request processed in 120us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.783793:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788850900.784615:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613440:0@lo:101: 00010000:00010000:3.0:1788850900.784755:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.784765:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850900.785337:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa5f9e5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613568:0@lo:501: 00000100:00100000:1.0:1788850900.785683:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850900.785781:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c149325 going to sleep for 11 seconds 00000100:00100000:2.0:1788850900.785832:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613568 00000100:00100000:2.0:1788850900.785839:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613568 00000100:00100000:2.0:1788850900.785915:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788850900.785923:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f1db59b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:7464:x1875746019613568:12345-0@lo:501: 00000100:00100000:2.0:1788850900.786073:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f1db59b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:7464:x1875746019613568:12345-0@lo:501: Request processed in 151us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.786081:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788850900.786160:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa5f9e5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613568:0@lo:501: 00000100:00100000:0.0:1788850900.786190:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe74b3f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613696:0@lo:503: 00000100:00100000:0.0:1788850900.786236:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850900.786394:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd0dc2bc going to sleep for 11 seconds 00000100:00100000:1.0:1788850900.786575:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613696 00000100:00100000:1.0:1788850900.786581:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613696 00000100:00100000:1.0:1788850900.786605:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788850900.786610:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001419fc61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:7464:x1875746019613696:12345-0@lo:503: 00000040:00080000:1.0:1788850900.786649:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788850900.786707:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001419fc61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:7464:x1875746019613696:12345-0@lo:503: Request processed in 87us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.786714:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788850900.786794:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe74b3f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613696:0@lo:503: 00000040:00080000:0.0:1788850900.787105:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850900.787149:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788850900.787221:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850900.788304:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788850900.788421:0:7464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788850900.788449:0:7464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788850900.788465:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.788477:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850900.788541:0:7464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788850900.788545:0:7464:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892ebbbf6000 10000000:01000000:3.0:1788850900.788548:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892ebbbf6000 10000000:01000000:3.0:1788850900.788552:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788850900.788558:0:7464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ebbbf6000 from 1 10000000:01000000:3.0:1788850900.788560:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788850900.788596:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000004d7638f/0x3e0030720b2055d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.788603:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000004d7638f/0x3e0030720b2055d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.788613:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000004d7638f/0x3e0030720b2055d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.788643:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613824:0@lo:101: 00000100:00100000:3.0:1788850900.788709:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.788856:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017e76a6c going to sleep for 11 seconds 00000100:00080000:1.0:1788850900.789286:0:6539:0:(import.c:65:import_set_state_nolock()) 000000005036d313 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788850900.789356:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062df529f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875746019612928:12345-0@lo:38: Request processed in 12172us (12284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.789392:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788850900.789424:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613824 00000100:00100000:1.0:1788850900.789430:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613824 00000100:00100000:3.0:1788850900.789436:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788850900.789446:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788850900.789454:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788850900.789465:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788850900.789467:0:3646:0:(import.c:65:import_set_state_nolock()) 000000003359e49f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788850900.789479:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e732b7d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019612928:0@lo:38: 00000100:00100000:1.0:1788850900.790096:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788850900.790105:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a8fd28fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:7464:x1875746019613824:12345-0@lo:101: 00010000:00010000:1.0:1788850900.790116:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850900.790132:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e13cc51e/0x3e0030720b2055d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2055d2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.790157:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e13cc51e/0x3e0030720b2055d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2055d2 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.790169:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e13cc51e/0x3e0030720b2055d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2055d2 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.790178:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e13cc51e, rc 0) 00000100:00100000:1.0:1788850900.790227:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a8fd28fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019613824:12345-0@lo:101: Request processed in 125us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.790233:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788850900.790266:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1f15c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019613952:0@lo:41: 00000100:00100000:3.0:1788850900.790277:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019613824:0@lo:101: 00010000:00010000:3.0:1788850900.790293:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000004d7638f/0x3e0030720b2055d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850900.790303:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850900.790304:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000004d7638f/0x3e0030720b2055d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850900.790349:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613952 00000100:00100000:1.0:1788850900.790354:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613952 00000100:00100000:3.0:1788850900.790467:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614080:0@lo:501: 00000100:00100000:3.0:1788850900.790493:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.790506:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017e76a6c going to sleep for 11 seconds 00000100:00100000:1.0:1788850900.790532:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788850900.790541:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a9648ce0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875746019613952:12345-0@lo:41: 00000004:00000024:1.0:1788850900.790564:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788850900.790611:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a9648ce0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875746019613952:12345-0@lo:41: Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.790625:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788850900.790645:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614080 00000100:00100000:1.0:1788850900.790649:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614080 00000100:00100000:1.0:1788850900.790664:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788850900.790669:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d58ba79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614080:12345-0@lo:501: 00000100:00100000:3.0:1788850900.790802:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1f15c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019613952:0@lo:41: 00000100:00100000:1.0:1788850900.792339:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d58ba79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614080:12345-0@lo:501: Request processed in 1664us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.792352:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788850900.792751:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614080:0@lo:501: 00000100:00100000:3.0:1788850900.792801:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614208:0@lo:503: 00000100:00100000:3.0:1788850900.792857:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.792899:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017e76a6c going to sleep for 11 seconds 00000100:00100000:2.0:1788850900.792910:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614208 00000100:00100000:2.0:1788850900.792918:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614208 00000100:00100000:2.0:1788850900.792965:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788850900.792971:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005c19234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614208:12345-0@lo:503: 00000100:00100000:2.0:1788850900.793261:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005c19234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614208:12345-0@lo:503: Request processed in 290us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.793268:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788850900.793312:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614208:0@lo:503: 00000040:00080000:3.0:1788850900.793860:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788850900.794010:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614336:0@lo:502: 00000100:00100000:3.0:1788850900.794084:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.794107:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017e76a6c going to sleep for 11 seconds 00000100:00100000:2.0:1788850900.794557:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614336 00000100:00100000:2.0:1788850900.794564:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614336 00000100:00100000:2.0:1788850900.794599:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788850900.794606:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed64d8ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614336:12345-0@lo:502: 00000100:00100000:2.0:1788850900.794720:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed64d8ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614336:12345-0@lo:502: Request processed in 114us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.794727:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788850900.794815:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614336:0@lo:502: 00000040:00080000:3.0:1788850900.796144:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788850900.796189:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788850900.796202:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788850900.796213:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788850900.796225:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788850900.796235:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788850900.796246:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788850900.796260:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788850900.796273:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788850900.796283:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788850900.796293:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788850900.797506:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788850900.797519:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788850900.797531:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788850900.797545:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788850900.797557:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788850900.797568:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788850900.797579:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788850900.797589:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788850900.797619:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788850900.798039:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788850900.798060:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788850900.798076:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788850900.798090:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788850900.798104:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788850900.798118:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788850900.798133:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788850900.798146:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788850900.798189:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614464:0@lo:502: 00000100:00100000:3.0:1788850900.798265:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.798326:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017e76a6c going to sleep for 11 seconds 00000100:00100000:2.0:1788850900.798326:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614464 00000100:00100000:2.0:1788850900.798335:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614464 00000100:00100000:2.0:1788850900.798403:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788850900.798411:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000112b33bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614464:12345-0@lo:502: 00000100:00100000:2.0:1788850900.798686:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000112b33bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614464:12345-0@lo:502: Request processed in 275us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.798694:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788850900.799447:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614464:0@lo:502: 00000040:00080000:3.0:1788850900.799509:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788850900.799527:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788850900.804386:0:7483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788850900.804405:0:7483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000000f5be198) 00000020:00000080:3.0:1788850900.804427:0:7483:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788850900.804566:0:7483:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002d0d2641 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788850900.804571:0:7483:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002d0d2641 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788850900.804574:0:7483:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002d0d2641 3 00010000:00080000:3.0:1788850900.804611:0:7483:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ef26d326@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1788850900.806298:0:7483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788850900.806485:0:7483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788850900.806520:0:7483:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788850900.806531:0:7483:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x3e0030720b2055e7 00000100:00080000:3.0:1788850900.806540:0:7483:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788850900.806548:0:7483:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ef26d326 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788850900.806582:0:7483:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000018630a52 x1875746019614592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788850900.806609:0:7483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788850900.806822:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019614592:0@lo:38: 00000100:00100000:1.0:1788850900.806888:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.807716:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614592 00000100:00100000:3.0:1788850900.807725:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614592 00000100:00100000:3.0:1788850900.809866:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788850900.809875:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000049b5fabb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019614592:12345-0@lo:38: 00010000:00080000:3.0:1788850900.809905:0:6535:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1788850900.809944:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3e0030720b2055ee 00000004:00100000:3.0:1788850900.809960:0:6535:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788850900.809990:0:6535:0:(import.c:65:import_set_state_nolock()) 00000000f4c7aba7 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850900.810092:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000049b5fabb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875746019614592:12345-0@lo:38: Request processed in 216us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850900.810100:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788850900.810124:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000018630a52 x1875746019614592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788850910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850900.810136:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788850900.810143:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788850900.810151:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788850900.810155:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788850900.810157:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000ef26d326 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788850900.810162:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018630a52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019614592:0@lo:38: 00000040:00080000:0.0:1788850900.812171:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788850900.812355:0:7464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788850900.812400:0:7464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788850900.812420:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000004d7638f/0x3e0030720b2055d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.812431:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000004d7638f/0x3e0030720b2055d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788850900.812662:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788850900.812665:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788850900.812666:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850900.812667:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850900.812668:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850900.812670:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850900.812671:0:7464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788850900.812673:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850900.812674:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850900.812675:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850900.812677:0:7464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788850900.812680:0:7464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1788850900.812682:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788850900.812687:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788850900.812688:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850900.812689:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850900.812690:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850900.812691:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850900.812692:0:7464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788850900.812693:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850900.812694:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850900.812694:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850900.812705:0:7464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788850900.812733:0:7464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788850900.812748:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ffd21655 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614720:0@lo:253: 00000100:00100000:1.0:1788850900.812812:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850900.812852:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f12fafa going to sleep for 11 seconds 00000100:00100000:0.0:1788850900.812898:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614720 00000100:00100000:0.0:1788850900.812904:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614720 40000000:00080000:1.0:1788850900.812917:0:7484:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1788850900.812948:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788850900.812957:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001032fb53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614720:12345-0@lo:253: 20000000:01000000:0.0:1788850900.812981:0:6528:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788850900.812994:0:6528:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788850900.814749:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788850900.814832:0:6528:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788850900.814850:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788850900.815052:0:6550:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788850900.815057:0:6550:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788850900.815076:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.815096:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20550e expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.815103:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2055b6 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.815124:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.815157:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2055b6 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.815171:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2055b6 expref: 15 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850900.815182:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065b0b02c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019614848:0@lo:104: 00000100:00100000:2.0:1788850900.815235:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850900.815428:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b20550e expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850900.815436:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b20550e expref: 15 pid: 6529 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850900.815444:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008cb76080 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019614976:0@lo:104: 00000100:00100000:2.0:1788850900.815467:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850900.815536:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c73716ca going to sleep for 11 seconds 00000100:00100000:1.0:1788850900.818078:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001032fb53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7464:x1875746019614720:12345-0@lo:253: Request processed in 5114us (5258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.818092:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788850900.818102:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ffd21655 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:7464:1875746019614720:0@lo:253: 10000000:01000000:2.0:1788850900.818117:0:7464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788850900.818120:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788850900.818122:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788850900.818124:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788850900.818125:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788850900.818126:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788850900.818127:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788850900.818128:0:7464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788850900.818130:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788850900.818140:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788850900.818141:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788850900.818143:0:7464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788850900.818158:0:7464:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788850900.823142:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614848 00000100:00100000:0.0:1788850900.823158:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614848 00000100:00100000:0.0:1788850900.823197:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614976 00000100:00100000:0.0:1788850900.823200:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614976 00000100:00100000:0.0:1788850900.823231:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788850900.823237:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004727ee68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6550:x1875746019614848:12345-0@lo:104: 00010000:00010000:0.0:1788850900.823255:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825257:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788850900.825270:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004727ee68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6550:x1875746019614848:12345-0@lo:104: Request processed in 2031us (10033us total) trans 0 rc 0/0 00010000:00010000:3.0:1788850900.825281:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788850900.825285:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788850900.825288:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825297:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b8503e10 already unused, calling callback (00000000654d1d4b) 10000000:00010000:3.0:1788850900.825300:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825308:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850900.825308:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 10000000:00010000:3.0:1788850900.825314:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850900.825316:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098f1b097 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6550:x1875746019614976:12345-0@lo:104: 10000000:01000000:3.0:1788850900.825320:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850900.825327:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825354:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825360:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788850900.825361:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788850900.825363:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098f1b097 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6550:x1875746019614976:12345-0@lo:104: Request processed in 51us (9897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.825368:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788850900.825375:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825381:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2055bd expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825392:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788850900.825394:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825399:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008987ffa9 already unused, calling callback (00000000654d1d4b) 10000000:00010000:3.0:1788850900.825401:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825415:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788850900.825421:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850900.825426:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788850900.825439:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825446:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788850900.825459:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825465:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20550e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205515 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825478:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850900.825479:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850900.825480:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850900.825488:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788850900.825500:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1f15c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019615104:0@lo:103: 00000100:00100000:3.0:1788850900.825552:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850900.825603:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615104 00000100:00100000:3.0:1788850900.825609:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615104 00010000:00010000:1.0:1788850900.825674:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850900.825683:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019615232:0@lo:103: 00000100:00100000:1.0:1788850900.825721:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850900.825752:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615232 00000100:00100000:1.0:1788850900.825756:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615232 00010000:00010000:3.0:1788850900.825763:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2055b6 expref: 16 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825768:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20550e expref: 16 pid: 6529 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.825792:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788850900.825798:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e4aa9869 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:3647:x1875746019615104:12345-0@lo:103: 00010000:00010000:3.0:1788850900.825814:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850900.825819:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2055b6 expref: 16 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825830:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2055b6 expref: 16 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850900.825845:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850900.825870:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e4aa9869 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:3647:x1875746019615104:12345-0@lo:103: Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.825870:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850900.825876:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788850900.825877:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005893bdb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:3649:x1875746019615232:12345-0@lo:103: 00010000:00010000:1.0:1788850900.825884:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850900.825887:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20550e expref: 15 pid: 6529 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825895:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b20550e expref: 15 pid: 6529 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825905:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850900.825912:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1f15c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019615104:0@lo:103: 00010000:00010000:1.0:1788850900.825912:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788850900.825925:0:7476:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010869659s 00010000:00010000:1.0:1788850900.825930:0:7476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825935:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825942:0:7476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825953:0:7476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825958:0:7476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000892de194 already unused, calling callback (00000000a093a272) 00010000:00010000:1.0:1788850900.825961:0:7476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825967:0:7476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825974:0:7476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850900.825983:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850900.826037:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005893bdb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:3649:x1875746019615232:12345-0@lo:103: Request processed in 161us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.826044:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850900.826096:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019615232:0@lo:103: 00010000:00010000:0.0:1788850900.826636:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c426aeb3/0x3e0030720b2055bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2055b6 expref: 14 pid: 6528 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850900.826650:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065b0b02c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019614848:0@lo:104: 00010000:00010000:0.0:1788850900.826659:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000483e4ed2/0x3e0030720b205515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b20550e expref: 13 pid: 6529 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850900.826666:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008cb76080 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019614976:0@lo:104: 00010000:00010000:0.0:1788850900.826684:0:6550:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.826692:0:6550:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.826709:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850900.826715:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000892de194/0x3e0030720b2055f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788850900.831603:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788850900.832280:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788850900.832487:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788850900.832937:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788850900.833461:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788850900.833879:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788850900.835244:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788850900.835784:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788850900.835968:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788850900.836487:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788850900.836919:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788850900.837351:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1788850900.839219:0:7464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788850900.839341:0:7488:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788850900.839346:0:7488:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788850900.839845:0:7489:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788850900.839897:0:7489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd21e453 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7489:1875746019615360:0@lo:700: 00000100:00100000:2.0:1788850900.839965:0:7489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850900.840057:0:7489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000debfd037 going to sleep for 11 seconds 00000100:00100000:3.0:1788850900.840178:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615360 00000100:00100000:3.0:1788850900.840186:0:6541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615360 00000100:00100000:3.0:1788850900.840234:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850900.840242:0:6541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000998d113e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7489:x1875746019615360:12345-0@lo:700: 00000040:01000000:1.0:1788850900.840523:0:7464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788850900.841235:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019615488:0@lo:1000: 00000100:00100000:2.0:1788850900.841358:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850900.841394:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017aa33a2 going to sleep for 11 seconds 00000100:00100000:3.0:1788850900.841442:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615488 00000100:00100000:3.0:1788850900.841448:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615488 00000100:00100000:3.0:1788850900.841518:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788850900.841525:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b5e50e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019615488:12345-0@lo:1000: 00000100:00100000:3.0:1788850900.841612:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b5e50e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019615488:12345-0@lo:1000: Request processed in 88us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850900.841619:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788850900.841687:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019615488:0@lo:1000: 00000040:01000000:2.0:1788850900.841725:0:7490:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788850900.841747:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019615616:0@lo:700: 00000100:00100000:2.0:1788850900.841781:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850900.841806:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615616 00000100:00100000:2.0:1788850900.841809:0:6543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615616 00000100:00100000:2.0:1788850900.841832:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850900.841837:0:6543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e8025c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019615616:12345-0@lo:700: 00000100:00100000:2.0:1788850900.841871:0:6543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e8025c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019615616:12345-0@lo:700: Request processed in 34us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.841877:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850900.841891:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029c77251 going to sleep for 11 seconds 00000100:00100000:2.0:1788850900.841903:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019615616:0@lo:700: 00000100:00100000:2.0:1788850900.841936:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7490:1875746019615744:0@lo:900: 00000100:00100000:2.0:1788850900.841959:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850900.841985:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615744 00000100:00100000:2.0:1788850900.841988:0:6545:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615744 00000100:00100000:2.0:1788850900.842030:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850900.842036:0:6545:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad52dbfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7490:x1875746019615744:12345-0@lo:900: 00000100:00100000:2.0:1788850900.842067:0:6545:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad52dbfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7490:x1875746019615744:12345-0@lo:900: Request processed in 32us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850900.842073:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850900.842086:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029c77251 going to sleep for 11 seconds 00010000:00080000:2.0:1788850900.842097:0:7490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d1092905 x1875746019615744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788850916 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850900.842107:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7490:1875746019615744:0@lo:900: 00000100:00100000:2.0:1788850900.842156:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019615872:0@lo:1000: 00000100:00100000:2.0:1788850900.842179:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788850900.842898:0:7464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788850900.843006:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788850900.843463:0:7464:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788850900.843469:0:7464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788850900.843602:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850900.844582:0:7464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788850900.845148:0:7464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788850900.845175:0:7464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788850900.845317:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788850900.846169:0:7464:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1788850900.846657:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1121a8a going to sleep for 11 seconds 00100000:10000000:1.0:1788850900.847395:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788850900.847749:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788850900.847895:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788850900.848050:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788850900.848205:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:0.0:1788850900.848466:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615872 00000100:00100000:0.0:1788850900.848477:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615872 00000100:00100000:0.0:1788850900.848847:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788850900.848860:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3338307 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019615872:12345-0@lo:1000: 00000100:00100000:0.0:1788850900.848979:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3338307 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019615872:12345-0@lo:1000: Request processed in 123us (6799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850900.848994:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850900.849145:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019615872:0@lo:1000: 00000004:00080000:2.0:1788850900.849205:0:7490:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000029c77251 with version 0 00000020:00100000:2.0:1788850900.849226:0:7490:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788850900.849232:0:7490:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d1092905 x1875746019616128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788850900.849251:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019616128:0@lo:1000: 00000100:00100000:2.0:1788850900.849298:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850900.849333:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d898612 going to sleep for 11 seconds 00000100:00100000:0.0:1788850900.849432:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616128 00000100:00100000:0.0:1788850900.849437:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616128 00000100:00100000:0.0:1788850900.849458:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788850900.849463:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008cb76080 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019616128:12345-0@lo:1000: 00100000:10000000:1.0:1788850900.850458:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788850900.850926:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788850900.851100:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788850900.851247:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788850900.851406:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788850900.851708:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788850900.851860:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788850900.852045:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788850900.852196:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788850900.852355:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788850900.852488:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788850900.852843:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788850900.852991:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788850900.853195:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788850900.853346:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788850900.853490:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788850900.853613:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788850900.853769:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788850900.853922:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788850900.854085:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788850900.854225:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788850900.854368:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788850900.855200:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788850900.855805:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788850900.855945:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788850900.856173:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788850900.856775:0:7464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788850900.856997:0:7464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788850900.860909:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:0.0:1788850900.861007:0:6541:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1788850900.863506:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008cb76080 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019616128:12345-0@lo:1000: Request processed in 14035us (14201us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788850900.863521:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788850900.863716:0:7490:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788850900.863722:0:7490:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788850900.863736:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019616128:0@lo:1000: 00000100:00100000:2.0:1788850900.863830:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019616256:0@lo:1000: 00000100:00100000:2.0:1788850900.863866:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850900.863919:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017aa33a2 going to sleep for 11 seconds 00000100:00100000:1.0:1788850900.864720:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616256 00000100:00100000:1.0:1788850900.864729:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616256 00000100:00100000:1.0:1788850900.864785:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788850900.864794:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065b0b02c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019616256:12345-0@lo:1000: 00000100:00100000:1.0:1788850900.864889:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065b0b02c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7490:x1875746019616256:12345-0@lo:1000: Request processed in 96us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850900.864896:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788850900.864930:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7490:1875746019616256:0@lo:1000: 00000040:00080000:1.0:1788850900.864950:0:7490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788850900.864982:0:7490:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000007c96d436 with version 1 00000004:00080000:1.0:1788850900.864998:0:7480:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b3a44fe4 version 1 rpc_version 1 00000020:00100000:1.0:1788850900.865035:0:7480:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788850900.865042:0:7480:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003d7c4c81 x1875746019616512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788850900.865059:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d7c4c81 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7480:1875746019616512:0@lo:1000: 00000100:00100000:1.0:1788850900.865087:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850900.865121:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe044b93 going to sleep for 11 seconds 00000100:00100000:1.0:1788850900.865133:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616512 00000100:00100000:1.0:1788850900.865137:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616512 00000100:00100000:1.0:1788850900.865166:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788850900.865171:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d1d3ac49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875746019616512:12345-0@lo:1000: 00000040:00080000:1.0:1788850900.873165:0:7490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788850900.873241:0:7490:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788850900.874209:0:6541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000998d113e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7489:x1875746019615360:12345-0@lo:700: Request processed in 33963us (34239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850900.874238:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788850900.874449:0:7489:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fd21e453 x1875746019615360/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788850916 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850900.874464:0:7489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd21e453 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7489:1875746019615360:0@lo:700: 40000000:02000000:3.0:1788850900.874486:0:7489:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:1.0:1788850900.875466:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788850900.876059:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d1d3ac49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875746019616512:12345-0@lo:1000: Request processed in 10886us (10969us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788850900.876072:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788850900.876379:0:7480:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788850900.876384:0:7480:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788850900.876401:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d7c4c81 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7480:1875746019616512:0@lo:1000: 00000001:00080000:2.0:1788850900.879182:0:7464:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788850900.879223:0:7464:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa9904558f988 00100000:10000000:2.0:1788850900.879232:0:7464:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788850900.879948:0:7464:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788850900.879982:0:7464:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788850900.880004:0:7464:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788850900.880084:0:7464:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788850900.880858:0:7464:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788850900.881047:0:7464:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1788850900.913766:0:7489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788850900.928077:0:7489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788850900.928161:0:7489:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788850900.928167:0:7489:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1788850901.172167:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850902.196287:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850903.220965:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850904.251173:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850904.919749:0:7734:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788850905.272479:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788850905.847225:0:7787:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788850905.847412:0:7787:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788850906.037844:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019616640:0@lo:41: 00000100:00100000:3.0:1788850906.038040:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850906.038121:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616640 00000100:00100000:3.0:1788850906.038128:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616640 00000100:00100000:3.0:1788850906.038178:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788850906.038186:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f1f15c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019616640:12345-0@lo:41: 00000004:00000024:3.0:1788850906.038709:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788850906.038767:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f1f15c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019616640:12345-0@lo:41: Request processed in 581us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850906.038775:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788850906.038825:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019616640:0@lo:41: 00000100:00100000:3.0:1788850906.039469:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019616768:0@lo:400: 00000100:00100000:3.0:1788850906.039511:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850906.039541:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788850906.039546:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019616896:0@lo:400: 00000100:00100000:3.0:1788850906.039569:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850906.040702:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616896 00000100:00100000:3.0:1788850906.040713:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616896 00000100:00100000:3.0:1788850906.040769:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850906.040778:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029d5107c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019616896:12345-0@lo:400: 00000100:00100000:3.0:1788850906.040847:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029d5107c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019616896:12345-0@lo:400: Request processed in 70us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850906.040856:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616768 00000100:00100000:0.0:1788850906.040863:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616768 00000100:00100000:3.0:1788850906.040882:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788850906.040903:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788850906.040910:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cdee4fec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:3647:x1875746019616768:12345-0@lo:400: 00000100:00100000:0.0:1788850906.040948:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cdee4fec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:3647:x1875746019616768:12345-0@lo:400: Request processed in 40us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850906.040955:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788850906.041715:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000028e3d7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019617024:0@lo:400: 00000100:00100000:3.0:1788850906.041753:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850906.041799:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617024 00000100:00100000:3.0:1788850906.041804:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617024 00000100:00100000:3.0:1788850906.041831:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788850906.041837:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005109f0a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019617024:12345-0@lo:400: 00000100:00100000:3.0:1788850906.041874:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005109f0a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019617024:12345-0@lo:400: Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850906.041880:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788850906.042768:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000028e3d7b x1875746019617024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850906.042784:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000028e3d7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019617024:0@lo:400: 00010000:00080000:3.0:1788850906.042821:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000023e76068 x1875746019616896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850906.042830:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019616896:0@lo:400: 00000100:00100000:3.0:1788850906.042840:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019616768:0@lo:400: 00010000:00010000:3.0:1788850906.294337:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850907.317150:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850908.341446:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788850908.597669:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788850908.597682:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892ebbbf6000 from 4 10000000:01000000:3.0:1788850908.597690:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788850908.597753:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.597769:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.597799:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850908.597828:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617152:0@lo:101: 00000100:00100000:3.0:1788850908.597922:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.597998:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd4d0063 going to sleep for 11 seconds 00000100:00100000:0.0:1788850908.598284:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617152 00000100:00100000:0.0:1788850908.598295:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617152 00000100:00100000:0.0:1788850908.598368:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788850908.598378:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004204828f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:6531:x1875746019617152:12345-0@lo:101: 00010000:00010000:0.0:1788850908.598395:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850908.598419:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008966fb7e/0x3e0030720b205603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2055fc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.598448:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008966fb7e/0x3e0030720b205603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2055fc expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.598458:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008966fb7e/0x3e0030720b205603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2055fc expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.598468:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008966fb7e, rc 0) 00000100:00100000:0.0:1788850908.598532:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004204828f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:6531:x1875746019617152:12345-0@lo:101: Request processed in 156us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850908.598540:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788850908.601140:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617152:0@lo:101: 00010000:00010000:3.0:1788850908.601182:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.601196:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850908.601297:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617280:0@lo:256: 00000100:00100000:3.0:1788850908.601381:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.601430:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd4d0063 going to sleep for 11 seconds 00000100:00100000:3.0:1788850908.601467:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617280 00000100:00100000:3.0:1788850908.601764:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617280 00000100:00100000:3.0:1788850908.601826:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788850908.601835:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ae54488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:6531:x1875746019617280:12345-0@lo:256: 20000000:01000000:3.0:1788850908.601859:0:6526:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788850908.601879:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788850908.601883:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788850908.601983:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ae54488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:6531:x1875746019617280:12345-0@lo:256: Request processed in 149us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850908.601991:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788850908.602074:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617280:0@lo:256: 10000000:01000000:3.0:1788850908.602125:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788850908.602132:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.602142:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 00000000b8503e10/0x3e0030720b2055fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850908.602153:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788850908.602155:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892e91596800 from 21 10000000:01000000:3.0:1788850908.602158:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788850908.602186:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20560a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.602192:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20560a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.602200:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20560a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850908.602214:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617408:0@lo:101: 00000100:00100000:3.0:1788850908.602245:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.602260:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd4d0063 going to sleep for 11 seconds 00000100:00100000:3.0:1788850908.602274:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617408 00000100:00100000:3.0:1788850908.602278:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617408 00000100:00100000:3.0:1788850908.602302:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788850908.602307:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000badacd84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:6531:x1875746019617408:12345-0@lo:101: 00010000:00010000:3.0:1788850908.602316:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850908.602330:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000402bb0ed/0x3e0030720b205611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20560a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.602360:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000402bb0ed/0x3e0030720b205611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20560a expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.602372:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000402bb0ed/0x3e0030720b205611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20560a expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.602382:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000402bb0ed, rc 0) 00000100:00100000:3.0:1788850908.602408:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000badacd84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019617408:12345-0@lo:101: Request processed in 101us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850908.602414:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788850908.602454:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617408:0@lo:101: 00010000:00010000:3.0:1788850908.602465:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20560a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.602472:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20560a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850908.604953:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617536:0@lo:501: 00000100:00100000:3.0:1788850908.605043:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.605089:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd4d0063 going to sleep for 11 seconds 00000100:00100000:0.0:1788850908.605187:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617536 00000100:00100000:0.0:1788850908.605195:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617536 00000100:00100000:0.0:1788850908.605248:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788850908.605255:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000f18e9f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019617536:12345-0@lo:501: 00000100:00100000:0.0:1788850908.605405:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000f18e9f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019617536:12345-0@lo:501: Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850908.605413:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788850908.606241:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617536:0@lo:501: 00000100:00100000:3.0:1788850908.606310:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617664:0@lo:503: 00000100:00100000:3.0:1788850908.606386:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.606426:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd4d0063 going to sleep for 11 seconds 00000100:00100000:1.0:1788850908.609284:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617664 00000100:00100000:1.0:1788850908.609304:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617664 00000100:00100000:1.0:1788850908.609371:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788850908.609381:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009cf21400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019617664:12345-0@lo:503: 00000100:00100000:1.0:1788850908.609874:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009cf21400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019617664:12345-0@lo:503: Request processed in 494us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850908.609884:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788850908.610069:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019617664:0@lo:503: 00000100:00100000:3.0:1788850908.612435:0:7871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:7871:1875746019617792:0@lo:502: 00000100:00100000:3.0:1788850908.612585:0:7871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.613782:0:7871:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041618cdb going to sleep for 11 seconds 00000100:00100000:0.0:1788850908.624333:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617792 00000100:00100000:0.0:1788850908.624351:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617792 00000100:00100000:0.0:1788850908.629353:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788850908.629370:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000105686b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7871:x1875746019617792:12345-0@lo:502: 00000100:00100000:0.0:1788850908.629956:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000105686b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7871:x1875746019617792:12345-0@lo:502: Request processed in 587us (17369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850908.629966:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788850908.630243:0:7871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9947fd0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:7871:1875746019617792:0@lo:502: 00000100:00100000:2.0:1788850908.630358:0:7871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060cfb98e pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:7871:1875746019617920:0@lo:502: 00000100:00100000:2.0:1788850908.630411:0:7871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850908.630462:0:7871:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035291029 going to sleep for 11 seconds 00000100:00100000:0.0:1788850908.630972:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617920 00000100:00100000:0.0:1788850908.630982:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617920 00000100:00100000:0.0:1788850908.631139:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788850908.631148:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec6b866b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7871:x1875746019617920:12345-0@lo:502: 00000100:00100000:0.0:1788850908.631283:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec6b866b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:7871:x1875746019617920:12345-0@lo:502: Request processed in 136us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850908.631290:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788850908.631427:0:7871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060cfb98e pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:7871:1875746019617920:0@lo:502: 00000040:00080000:2.0:1788850908.631464:0:7871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788850908.632719:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788850908.632757:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788850908.632768:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20560a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.632782:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000008987ffa9/0x3e0030720b20560a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850908.632794:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788850908.632797:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e91596800 from 4 10000000:01000000:0.0:1788850908.632800:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788850908.632845:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000039ba5b20/0x3e0030720b205618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.632853:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000039ba5b20/0x3e0030720b205618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.632864:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000039ba5b20/0x3e0030720b205618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850908.632887:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe74b3f3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618048:0@lo:101: 00000100:00100000:0.0:1788850908.633000:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850908.633190:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618048 00000100:00100000:2.0:1788850908.633199:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618048 00000100:00100000:2.0:1788850908.633245:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788850908.633253:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006113cb8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019618048:12345-0@lo:101: 00010000:00010000:2.0:1788850908.633267:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850908.633282:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082445aa8/0x3e0030720b20561f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205618 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.633348:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082445aa8/0x3e0030720b20561f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205618 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.633360:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082445aa8/0x3e0030720b20561f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205618 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.633370:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082445aa8, rc 0) 00000100:00100000:0.0:1788850908.633498:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aec2dcd8 going to sleep for 11 seconds 00000100:00100000:2.0:1788850908.633729:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006113cb8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019618048:12345-0@lo:101: Request processed in 477us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850908.633735:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788850908.633815:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe74b3f3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618048:0@lo:101: 00010000:00010000:0.0:1788850908.633856:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000039ba5b20/0x3e0030720b205618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.633865:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000039ba5b20/0x3e0030720b205618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850908.633924:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe74b3f3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618176:0@lo:256: 00000100:00100000:0.0:1788850908.633961:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850908.633986:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aec2dcd8 going to sleep for 11 seconds 00000100:00100000:0.0:1788850908.634006:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618176 00000100:00100000:0.0:1788850908.634035:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618176 00000100:00100000:0.0:1788850908.634060:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788850908.634066:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ce7a09c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019618176:12345-0@lo:256: 20000000:01000000:0.0:1788850908.634081:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788850908.634101:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788850908.634105:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788850908.634187:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ce7a09c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019618176:12345-0@lo:256: Request processed in 121us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850908.634194:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788850908.634225:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe74b3f3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618176:0@lo:256: 10000000:01000000:0.0:1788850908.634266:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788850908.634271:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000039ba5b20/0x3e0030720b205618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.634280:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000039ba5b20/0x3e0030720b205618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850908.634289:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788850908.634295:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788850908.634298:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788850908.634317:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 000000006e172ad5/0x3e0030720b205626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.634324:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 000000006e172ad5/0x3e0030720b205626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850908.634331:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 000000006e172ad5/0x3e0030720b205626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850908.634342:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe74b3f3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618304:0@lo:101: 00000100:00100000:0.0:1788850908.634368:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850908.634391:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aec2dcd8 going to sleep for 11 seconds 00000100:00100000:3.0:1788850908.634884:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618304 00000100:00100000:3.0:1788850908.634891:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618304 00000100:00100000:3.0:1788850908.634919:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788850908.634925:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed047485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019618304:12345-0@lo:101: 00010000:00010000:3.0:1788850908.634937:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850908.634950:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e45e217/0x3e0030720b20562d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205626 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.634972:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e45e217/0x3e0030720b20562d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205626 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.634983:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e45e217/0x3e0030720b20562d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205626 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850908.634992:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e45e217, rc 0) 00000100:00100000:3.0:1788850908.635277:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed047485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019618304:12345-0@lo:101: Request processed in 352us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850908.635286:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788850908.635301:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe74b3f3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618304:0@lo:101: 00010000:00010000:2.0:1788850908.635317:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 000000006e172ad5/0x3e0030720b205626 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.635341:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 000000006e172ad5/0x3e0030720b205626 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850908.635419:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060cfb98e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618432:0@lo:501: 00000100:00100000:2.0:1788850908.635447:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850908.635483:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 0000000031627092 going to sleep for 11 seconds 00000100:00100000:3.0:1788850908.635730:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618432 00000100:00100000:3.0:1788850908.635735:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618432 00000100:00100000:3.0:1788850908.635840:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788850908.635849:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009879fcb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019618432:12345-0@lo:501: 00000100:00100000:3.0:1788850908.636871:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009879fcb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019618432:12345-0@lo:501: Request processed in 1021us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850908.636880:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788850908.636939:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060cfb98e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618432:0@lo:501: 00000100:00100000:3.0:1788850908.636986:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618560:0@lo:503: 00000100:00100000:3.0:1788850908.637078:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850908.637302:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618560 00000100:00100000:0.0:1788850908.637309:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618560 00000100:00100000:0.0:1788850908.637383:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788850908.637391:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0a1f92b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019618560:12345-0@lo:503: 00000100:00100000:0.0:1788850908.637517:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0a1f92b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019618560:12345-0@lo:503: Request processed in 128us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850908.637524:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788850908.638928:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d801136 going to sleep for 11 seconds 00000100:00100000:3.0:1788850908.638980:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019618560:0@lo:503: 00000100:00100000:3.0:1788850908.641348:0:7872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:7872:1875746019618688:0@lo:502: 00000100:00100000:3.0:1788850908.641459:0:7872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.641522:0:7872:0:(client.c:2716:ptlrpc_set_wait()) set 00000000afc82f48 going to sleep for 11 seconds 00000100:00100000:2.0:1788850908.641614:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618688 00000100:00100000:2.0:1788850908.641624:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618688 00000100:00100000:2.0:1788850908.641934:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788850908.641944:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8bac824 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:7872:x1875746019618688:12345-0@lo:502: 00000100:00100000:2.0:1788850908.645685:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8bac824 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:7872:x1875746019618688:12345-0@lo:502: Request processed in 3730us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850908.645705:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788850908.659586:0:7872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:7872:1875746019618688:0@lo:502: 00000020:01000000:3.0:1788850908.661070:0:7872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788850908.661091:0:7872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788850908.661094:0:7872:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788850908.661113:0:7872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788850908.661119:0:7872:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:3.0:1788850908.661161:0:7872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788850908.661184:0:7872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000e01f4d85) 00000020:00000080:3.0:1788850908.661215:0:7872:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788850908.661222:0:7872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788850908.661360:0:7872:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788850908.661367:0:7872:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788850908.661377:0:7872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b20563b 00010000:00080000:3.0:1788850908.661426:0:7872:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000022142cd3@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788850908.671058:0:7872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788850908.673008:0:7872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788850908.673394:0:7872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788850908.673511:0:7872:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788850908.673553:0:7872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b205642 00000100:00080000:0.0:1788850908.673568:0:7872:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788850908.673581:0:7872:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000022142cd3 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788850908.673644:0:7872:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e040797e x1875746019618816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788850908.673686:0:7872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1788850908.673749:0:7872:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788850908.673977:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019618944:0@lo:400: 00000100:00100000:3.0:1788850908.674117:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.674228:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000028e3d7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019619072:0@lo:400: 00000100:00100000:3.0:1788850908.674264:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.674292:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788850908.674303:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000115b8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019619200:0@lo:400: 00000100:00100000:3.0:1788850908.674329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.674373:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618944 00000100:00100000:3.0:1788850908.674383:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618944 00000100:00100000:3.0:1788850908.674433:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619200 00000100:00100000:3.0:1788850908.674436:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619200 00000100:00100000:3.0:1788850908.674454:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850908.674464:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000707cb15f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019618944:12345-0@lo:400: 00000100:00100000:3.0:1788850908.674526:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000707cb15f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019618944:12345-0@lo:400: Request processed in 64us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850908.674534:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850908.674566:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850908.674573:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bca3ef8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019619200:12345-0@lo:400: 00000100:00100000:3.0:1788850908.674606:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bca3ef8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019619200:12345-0@lo:400: Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850908.674612:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850908.674632:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619072 00000100:00100000:3.0:1788850908.674636:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619072 00000100:00100000:3.0:1788850908.674678:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788850908.674684:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008696c0fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019619072:12345-0@lo:400: 00000100:00100000:3.0:1788850908.674718:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008696c0fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019619072:12345-0@lo:400: Request processed in 35us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850908.674725:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788850908.674787:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000115b8c9 x1875746019619200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850908.674802:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000115b8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019619200:0@lo:400: 00000100:00100000:3.0:1788850908.674813:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000028e3d7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019619072:0@lo:400: 00010000:00080000:3.0:1788850908.674851:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000023e76068 x1875746019618944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850908.674860:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019618944:0@lo:400: 00000100:00100000:2.0:1788850908.675427:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e040797e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019618816:0@lo:38: 00000100:00100000:2.0:1788850908.675485:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850908.675744:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618816 00000100:00100000:0.0:1788850908.676308:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618816 00000100:00100000:0.0:1788850908.676353:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788850908.676359:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014df1c7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019618816:12345-0@lo:38: 00010000:00080000:0.0:1788850908.676396:0:6539:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1788850908.676445:0:6539:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b205649 00000004:00100000:0.0:1788850908.676465:0:6539:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788850908.676472:0:6539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788850908.679181:0:7877:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000fe74b3f3 x1875746019619328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850908.679201:0:7877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6fcc560 going to sleep for 0 seconds 00000020:01000000:2.0:1788850908.679517:0:7872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850908.679527:0:7872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850908.679529:0:7872:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788850908.679532:0:7872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850908.679537:0:7872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850908.679538:0:7872:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788850908.679541:0:7872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788850908.679553:0:7872:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788850908.679584:0:7872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:7872:1875746019619456:0@lo:502: 00000100:00100000:2.0:1788850908.679984:0:7872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850908.681531:0:7872:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cb62f3d going to sleep for 11 seconds 00000100:00100000:0.0:1788850908.681592:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619456 00000100:00100000:0.0:1788850908.681719:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619456 00000100:00100000:0.0:1788850908.681904:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788850908.681915:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fbeac7f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:7872:x1875746019619456:12345-0@lo:502: 00000100:00100000:0.0:1788850908.682161:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fbeac7f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:7872:x1875746019619456:12345-0@lo:502: Request processed in 248us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850908.682171:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788850908.682342:0:7872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:7872:1875746019619456:0@lo:502: 00000020:01000000:2.0:1788850908.682385:0:7872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850908.682393:0:7872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850908.682396:0:7872:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788850908.682401:0:7872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788850908.682488:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788850908.682520:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788850908.682531:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 000000006e172ad5/0x3e0030720b205626 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.682542:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 000000006e172ad5/0x3e0030720b205626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850908.682566:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788850908.682569:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff892ebbbc99c0 from 1 10000000:01000000:2.0:1788850908.682572:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788850908.682619:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 0000000023aad0be/0x3e0030720b205650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.682628:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 0000000023aad0be/0x3e0030720b205650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.682637:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 0000000023aad0be/0x3e0030720b205650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850908.682945:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019619584:0@lo:101: 00000100:00100000:2.0:1788850908.683009:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850908.683065:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cb62f3d going to sleep for 11 seconds 00000100:00100000:2.0:1788850908.683087:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619584 00000100:00100000:2.0:1788850908.683113:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619584 00000100:00100000:2.0:1788850908.683145:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788850908.683152:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004fcf8aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019619584:12345-0@lo:101: 00010000:00010000:2.0:1788850908.683163:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850908.683176:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001637cad6/0x3e0030720b205657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205650 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.683203:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001637cad6/0x3e0030720b205657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205650 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.683214:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001637cad6/0x3e0030720b205657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205650 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.683224:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001637cad6, rc 0) 00000100:00100000:2.0:1788850908.683258:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004fcf8aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019619584:12345-0@lo:101: Request processed in 107us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850908.683263:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788850908.683296:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019619584:0@lo:101: 00010000:00010000:2.0:1788850908.683308:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 0000000023aad0be/0x3e0030720b205650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.683316:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 0000000023aad0be/0x3e0030720b205650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850908.683377:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019619712:0@lo:501: 00000100:00100000:2.0:1788850908.683402:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850908.683415:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cb62f3d going to sleep for 11 seconds 00000100:00100000:2.0:1788850908.683425:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619712 00000100:00100000:2.0:1788850908.683428:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619712 00000100:00100000:2.0:1788850908.683454:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788850908.683459:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009db9a85a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019619712:12345-0@lo:501: 00000100:00100000:2.0:1788850908.683534:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009db9a85a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019619712:12345-0@lo:501: Request processed in 76us (132us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788850908.683542:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788850908.683579:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019619712:0@lo:501: 10000000:01000000:2.0:1788850908.683603:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788850908.683608:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: 0000000023aad0be/0x3e0030720b205650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850908.683615:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: 0000000023aad0be/0x3e0030720b205650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788850908.705064:0:6539:0:(import.c:65:import_set_state_nolock()) 00000000320ed51d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850908.706297:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014df1c7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875746019618816:12345-0@lo:38: Request processed in 29930us (30805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850908.706312:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788850908.706373:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788850908.706387:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788850908.706398:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788850908.706405:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788850908.706408:0:3646:0:(import.c:65:import_set_state_nolock()) 0000000022142cd3 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788850908.706435:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e6fcc560): req@00000000fe74b3f3 x1875746019619328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850908.706469:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e040797e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019618816:0@lo:38: 00000100:00100000:3.0:1788850908.706515:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019619840:0@lo:41: 00000100:00100000:3.0:1788850908.706586:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850908.707055:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619840 00000100:00100000:3.0:1788850908.707065:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619840 00000100:00100000:3.0:1788850908.708329:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788850908.708349:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000028e3d7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019619840:12345-0@lo:41: 00000004:00000024:3.0:1788850908.708399:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788850908.708487:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000028e3d7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019619840:12345-0@lo:41: Request processed in 146us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850908.708494:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788850908.708884:0:7877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850908.710312:0:7877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6fcc560 going to sleep for 11 seconds 00000100:00100000:2.0:1788850908.714391:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619328 00000100:00100000:2.0:1788850908.714415:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619328 00000100:00100000:2.0:1788850908.714498:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788850908.714510:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e040797e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7877:x1875746019619328:12345-0@lo:1000: 00000100:00100000:2.0:1788850908.714717:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e040797e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7877:x1875746019619328:12345-0@lo:1000: Request processed in 208us (5834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850908.714726:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788850908.717292:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023e76068 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019619840:0@lo:41: 00000100:00100000:1.0:1788850908.717292:0:7877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe74b3f3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019619328:0@lo:1000: 00000040:01000000:1.0:1788850908.717355:0:7877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788850908.717417:0:7877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d7c4c81 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019619968:0@lo:1000: 00000100:00100000:1.0:1788850908.717516:0:7877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850908.717575:0:7877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb8c8e50 going to sleep for 11 seconds 00000100:00100000:2.0:1788850908.717584:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619968 00000100:00100000:2.0:1788850908.717596:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619968 00000100:00100000:2.0:1788850908.717657:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788850908.717666:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007829590d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7877:x1875746019619968:12345-0@lo:1000: 00000100:00100000:2.0:1788850908.717969:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007829590d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7877:x1875746019619968:12345-0@lo:1000: Request processed in 304us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850908.717986:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788850908.718918:0:7877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d7c4c81 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019619968:0@lo:1000: 00000100:00100000:1.0:1788850908.718994:0:7877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d7c4c81 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019620096:0@lo:700: 00000100:00100000:1.0:1788850908.719051:0:7877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850908.719075:0:7877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb8c8e50 going to sleep for 11 seconds 00000100:00100000:2.0:1788850908.719207:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620096 00000100:00100000:2.0:1788850908.719214:0:6544:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620096 00000100:00100000:2.0:1788850908.719256:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850908.719264:0:6544:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9734317 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7877:x1875746019620096:12345-0@lo:700: 00000100:00100000:2.0:1788850908.719321:0:6544:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9734317 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7877:x1875746019620096:12345-0@lo:700: Request processed in 57us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850908.719327:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850908.719358:0:7877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d7c4c81 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019620096:0@lo:700: 00000100:00100000:2.0:1788850908.719483:0:7877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019620224:0@lo:1000: 00000100:00100000:2.0:1788850908.719517:0:7877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850908.719532:0:7877:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c652545 going to sleep for 11 seconds 00000100:00100000:2.0:1788850908.719700:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620224 00000100:00100000:2.0:1788850908.719705:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620224 00000100:00100000:2.0:1788850908.719733:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788850908.719739:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aa8176c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7877:x1875746019620224:12345-0@lo:1000: 00000100:00100000:2.0:1788850908.719882:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aa8176c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7877:x1875746019620224:12345-0@lo:1000: Request processed in 143us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850908.719889:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788850908.719915:0:7877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019620224:0@lo:1000: 00000004:00080000:2.0:1788850908.719967:0:7877:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000002cb62f3d with version 0 00000020:00100000:2.0:1788850908.719983:0:7877:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788850908.719990:0:7877:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ea353b91 x1875746019620480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788850908.720819:0:7877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019620480:0@lo:1000: 00000100:00100000:2.0:1788850908.720877:0:7877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850908.720911:0:7877:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003109d4f going to sleep for 11 seconds 00000100:00100000:2.0:1788850908.720932:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620480 00000100:00100000:2.0:1788850908.720938:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620480 00000100:00100000:2.0:1788850908.720969:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788850908.720977:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060cfb98e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7877:x1875746019620480:12345-0@lo:1000: 00000001:00080000:3.0:1788850908.738148:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788850908.738170:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788850908.739396:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060cfb98e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7877:x1875746019620480:12345-0@lo:1000: Request processed in 18413us (18513us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788850908.739417:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1788850908.739491:0:7877:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788850908.739498:0:7877:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788850908.739520:0:7877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea353b91 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019620480:0@lo:1000: 00000100:00100000:1.0:1788850908.739658:0:7877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c1bd3e8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019620608:0@lo:1000: 00000100:00100000:1.0:1788850908.739713:0:7877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850908.739756:0:7877:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d255d3e going to sleep for 11 seconds 00000100:00100000:1.0:1788850908.739779:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620608 00000100:00100000:1.0:1788850908.739787:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620608 00000100:00100000:1.0:1788850908.739840:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788850908.739851:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d4a23f35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7877:x1875746019620608:12345-0@lo:1000: 00000100:00100000:1.0:1788850908.739939:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d4a23f35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7877:x1875746019620608:12345-0@lo:1000: Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850908.739946:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788850908.739973:0:7877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c1bd3e8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7877:1875746019620608:0@lo:1000: 00000040:00080000:3.0:1788850908.740010:0:7877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788850908.740076:0:7877:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000092c9ce2f with version 1 00000004:00080000:0.0:1788850908.740386:0:7875:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000016aa1232 version 1 rpc_version 1 00000020:00100000:0.0:1788850908.740410:0:7875:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788850908.740419:0:7875:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b731b1bb x1875746019620864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788850908.740437:0:7875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b731b1bb pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7875:1875746019620864:0@lo:1000: 00000100:00100000:0.0:1788850908.740487:0:7875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850908.740521:0:7875:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a5d0b6a going to sleep for 11 seconds 00000100:00100000:1.0:1788850908.740575:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620864 00000100:00100000:1.0:1788850908.740580:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620864 00000100:00100000:1.0:1788850908.740618:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788850908.740625:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078157995 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7875:x1875746019620864:12345-0@lo:1000: 00000001:00080000:0.0:1788850908.744991:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788850908.745280:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078157995 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7875:x1875746019620864:12345-0@lo:1000: Request processed in 4650us (4797us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788850908.745297:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1788850908.745727:0:7875:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788850908.745767:0:7875:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788850908.745793:0:7875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b731b1bb pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7875:1875746019620864:0@lo:1000: 00000040:00080000:3.0:1788850908.746902:0:7877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788850908.747009:0:7877:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788850908.747044:0:7877:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788850908.883676:0:7893:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788850908.884009:0:7893:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788850909.367817:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788850909.989359:0:7941:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3d9d8870 20000000:00000080:0.0:1788850909.989377:0:7941:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892ea4d4d000 uarg=0000000000000000 20000000:01000000:0.0:1788850909.989420:0:7941:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788850909.989428:0:7941:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788850909.989433:0:7941:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788850909.989936:0:7941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788850909.989950:0:7941:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788850909.996895:0:7941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850909.997158:0:7941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788850909.997190:0:7941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788850909.997208:0:7941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788850909.997223:0:7941:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788850909.997242:0:7941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850909.997266:0:7941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2054d6 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850909.997273:0:7941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2055c4 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850909.997280:0:7941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850909.997317:0:7941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2055c4 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850909.997330:0:7941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2055c4 expref: 17 pid: 6528 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850909.997344:0:7941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b731b1bb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7941:1875746019620992:0@lo:104: 00000100:00100000:0.0:1788850909.997413:0:7941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850909.998189:0:7941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2054d6 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850909.998200:0:7941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2054d6 expref: 17 pid: 6526 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850909.998210:0:7941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e732b7d6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7941:1875746019621120:0@lo:104: 00000100:00100000:1.0:1788850910.000416:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788850910.000463:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850910.001835:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620992 00000100:00100000:1.0:1788850910.001846:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620992 00000100:00100000:3.0:1788850910.003298:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621120 00000100:00100000:3.0:1788850910.003309:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621120 00000100:00100000:3.0:1788850910.003357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850910.003366:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000494b85dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:7941:x1875746019620992:12345-0@lo:104: 00010000:00010000:3.0:1788850910.003382:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850910.004391:0:7941:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2a98c17 going to sleep for 10 seconds 00000100:00100000:0.0:1788850910.004423:0:7941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b731b1bb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7941:1875746019620992:0@lo:104: 00010000:00010000:3.0:1788850910.010446:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788850910.010470:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000494b85dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:7941:x1875746019620992:12345-0@lo:104: Request processed in 7101us (13053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850910.010484:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850910.010702:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788850910.010713:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000684aa120 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:7941:x1875746019621120:12345-0@lo:104: 00010000:00010000:3.0:1788850910.010729:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850910.010880:0:7941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e732b7d6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7941:1875746019621120:0@lo:104: 00010000:00010000:2.0:1788850910.010908:0:7941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.011190:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788850910.011196:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.011232:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a6901700 already unused, calling callback (00000000654d1d4b) 10000000:00010000:0.0:1788850910.011235:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.011243:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850910.011248:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850910.011253:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788850910.011337:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.011345:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850910.011374:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.011382:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000a6901700/0x3e0030720b2055c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2055cb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.011394:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850910.011396:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.011402:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d47820ba already unused, calling callback (00000000654d1d4b) 10000000:00010000:0.0:1788850910.011404:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.011420:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850910.011425:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850910.011430:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788850910.011486:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006da30d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019621248:0@lo:103: 00000100:00100000:1.0:1788850910.011555:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850910.011948:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788850910.011956:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000684aa120 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:7941:x1875746019621120:12345-0@lo:104: Request processed in 1247us (11494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850910.011965:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788850910.011996:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621248 00000100:00100000:3.0:1788850910.012003:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621248 00010000:00010000:3.0:1788850910.012044:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2055c4 expref: 18 pid: 6528 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850910.012069:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850910.012075:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000070a157a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:3650:x1875746019621248:12345-0@lo:103: 00010000:00010000:3.0:1788850910.012085:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850910.012096:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2055c4 expref: 18 pid: 6528 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850910.012105:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2055c4 expref: 18 pid: 6528 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850910.012118:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000056d7e91f/0x3e0030720b2055cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2055c4 expref: 18 pid: 6528 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850910.012130:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850910.012165:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000070a157a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3650:x1875746019621248:12345-0@lo:103: Request processed in 92us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850910.012172:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850910.012218:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006da30d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019621248:0@lo:103: 00010000:00010000:1.0:1788850910.012352:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850910.012770:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.012780:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788850910.012811:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.012817:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: 00000000d47820ba/0x3e0030720b2054d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2054dd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.012832:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850910.012833:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850910.012835:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850910.012868:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788850910.012880:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055bd2c3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019621376:0@lo:103: 00000100:00100000:0.0:1788850910.012916:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850910.013042:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621376 00000100:00100000:1.0:1788850910.013048:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621376 00010000:00010000:1.0:1788850910.013066:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2054d6 expref: 17 pid: 6526 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850910.013089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788850910.013095:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000043ee78a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3648:x1875746019621376:12345-0@lo:103: 00010000:00010000:1.0:1788850910.013104:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850910.013108:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2054d6 expref: 17 pid: 6526 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013116:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2054d6 expref: 17 pid: 6526 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013137:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b83ab48/0x3e0030720b2054dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2054d6 expref: 17 pid: 6526 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013149:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013157:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013170:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013176:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013182:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013188:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013193:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022086dfb already unused, calling callback (00000000a093a272) 00010000:00010000:1.0:1788850910.013196:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013709:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013734:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.013756:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850910.013802:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000043ee78a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:3648:x1875746019621376:12345-0@lo:103: Request processed in 707us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850910.013809:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788850910.013844:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055bd2c3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019621376:0@lo:103: 00010000:00010000:0.0:1788850910.013896:0:7941:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.013905:0:7941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850910.013910:0:7941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022086dfb/0x3e0030720b20565e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850910.388471:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850911.157281:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000115b8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019621504:0@lo:41: 00000100:00100000:0.0:1788850911.157361:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850911.157490:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621504 00000100:00100000:3.0:1788850911.157510:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621504 00000100:00100000:3.0:1788850911.157564:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788850911.157572:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000766dbe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019621504:12345-0@lo:41: 00000004:00000024:3.0:1788850911.157608:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788850911.157658:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000766dbe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019621504:12345-0@lo:41: Request processed in 87us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850911.157665:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788850911.157708:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000115b8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019621504:0@lo:41: 00010000:00010000:1.0:1788850911.413252:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850912.436371:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850913.461201:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850913.725912:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb6b73bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019621888:0@lo:400: 00000100:00100000:2.0:1788850913.725982:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850913.726056:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850913.726061:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004727ee68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019622016:0@lo:400: 00000100:00100000:2.0:1788850913.726098:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850913.726141:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621888 00000100:00100000:2.0:1788850913.726149:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621888 00000100:00100000:2.0:1788850913.726192:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788850913.726200:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea353b91 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019621888:12345-0@lo:400: 00000100:00100000:2.0:1788850913.726265:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea353b91 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019621888:12345-0@lo:400: Request processed in 66us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850913.726272:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788850913.726296:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622016 00000100:00100000:2.0:1788850913.726299:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622016 00000100:00100000:2.0:1788850913.726324:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788850913.726330:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd24d1b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019622016:12345-0@lo:400: 00000100:00100000:2.0:1788850913.726357:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd24d1b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019622016:12345-0@lo:400: Request processed in 28us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850913.726369:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788850913.726406:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004727ee68 x1875746019622016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850913.726419:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004727ee68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019622016:0@lo:400: 00000100:00100000:2.0:1788850913.726429:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb6b73bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019621888:0@lo:400: 00000100:00100000:1.0:1788850913.726817:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd21e453 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019621632:0@lo:400: 00000100:00100000:1.0:1788850913.726856:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850913.726883:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098f1b097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019622144:0@lo:400: 00000100:00100000:1.0:1788850913.726908:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850913.726926:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788850913.726932:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019621760:0@lo:400: 00000100:00100000:1.0:1788850913.726952:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850913.727085:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621760 00000100:00100000:3.0:1788850913.727090:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621760 00000100:00100000:3.0:1788850913.727126:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788850913.727132:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002307a35d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019621760:12345-0@lo:400: 00000100:00100000:3.0:1788850913.727169:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002307a35d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019621760:12345-0@lo:400: Request processed in 38us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850913.727181:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788850913.727207:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d1092905 x1875746019621760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850913.727216:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1092905 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019621760:0@lo:400: 00000100:00100000:2.0:1788850913.727278:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621632 00000100:00100000:2.0:1788850913.727282:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621632 00000100:00100000:2.0:1788850913.727432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788850913.727440:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007d7ad4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:3649:x1875746019621632:12345-0@lo:400: 00000100:00100000:2.0:1788850913.727499:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007d7ad4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:3649:x1875746019621632:12345-0@lo:400: Request processed in 60us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850913.727505:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788850913.727566:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd21e453 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019621632:0@lo:400: 00000100:00100000:2.0:1788850913.727879:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622144 00000100:00100000:2.0:1788850913.727885:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622144 00000100:00100000:2.0:1788850913.727916:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850913.727923:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000055bd2c3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019622144:12345-0@lo:400: 00000100:00100000:2.0:1788850913.727969:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000055bd2c3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019622144:12345-0@lo:400: Request processed in 47us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850913.727975:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788850913.728073:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098f1b097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019622144:0@lo:400: 00000100:00100000:0.0:1788850914.233213:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c1bd3e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019622272:0@lo:41: 00000100:00100000:0.0:1788850914.233286:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850914.233397:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622272 00000100:00100000:1.0:1788850914.233405:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622272 00000100:00100000:1.0:1788850914.233606:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788850914.233618:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000349f947a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019622272:12345-0@lo:41: 00000004:00000024:1.0:1788850914.233658:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788850914.233719:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000349f947a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019622272:12345-0@lo:41: Request processed in 105us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850914.233727:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788850914.236777:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c1bd3e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019622272:0@lo:41: 00010000:00010000:1.0:1788850914.501600:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850915.516551:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850916.276362:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000115b8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019622400:0@lo:41: 00000100:00100000:2.0:1788850916.276446:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850916.276554:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622400 00000100:00100000:0.0:1788850916.276563:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622400 00000100:00100000:0.0:1788850916.276611:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788850916.276619:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018f3627e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019622400:12345-0@lo:41: 00000004:00000024:0.0:1788850916.276655:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788850916.276717:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018f3627e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019622400:12345-0@lo:41: Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850916.276724:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788850916.278232:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000115b8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019622400:0@lo:41: 00010000:00010000:1.0:1788850916.532217:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788850916.788821:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788850916.788830:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ebbbf6000 from 1 10000000:01000000:2.0:1788850916.788835:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788850916.788899:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: 00000000483e4ed2/0x3e0030720b205665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850916.788911:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: 00000000483e4ed2/0x3e0030720b205665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850916.788922:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: 00000000483e4ed2/0x3e0030720b205665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850916.788946:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009441e0f5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019622528:0@lo:101: 00000100:00100000:2.0:1788850916.789116:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850916.791723:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622528 00000100:00100000:3.0:1788850916.791739:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622528 00000100:00100000:3.0:1788850916.792040:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788850916.792050:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e26fa8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019622528:12345-0@lo:101: 00010000:00010000:3.0:1788850916.792068:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850916.792085:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000115795f3/0x3e0030720b20566c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205665 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850916.792112:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000115795f3/0x3e0030720b20566c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205665 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850916.792122:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000115795f3/0x3e0030720b20566c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205665 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850916.792129:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000115795f3, rc 0) 00000100:00100000:3.0:1788850916.792197:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e26fa8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019622528:12345-0@lo:101: Request processed in 149us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850916.792203:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788850916.794248:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ae0105e going to sleep for 11 seconds 00000100:00100000:3.0:1788850916.794294:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009441e0f5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019622528:0@lo:101: 00010000:00010000:3.0:1788850916.794332:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: 00000000483e4ed2/0x3e0030720b205665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850916.794344:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: 00000000483e4ed2/0x3e0030720b205665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850916.794510:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000565c594c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019622656:0@lo:501: 00000100:00100000:3.0:1788850916.794566:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850916.794661:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d067ff20 going to sleep for 11 seconds 00000100:00100000:2.0:1788850916.794744:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622656 00000100:00100000:2.0:1788850916.794751:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622656 00000100:00100000:2.0:1788850916.794800:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788850916.794807:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080c4f3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019622656:12345-0@lo:501: 00000100:00100000:2.0:1788850916.795039:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080c4f3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019622656:12345-0@lo:501: Request processed in 204us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850916.795048:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788850916.795229:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000565c594c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019622656:0@lo:501: 00000100:00100000:0.0:1788850916.795258:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a105b68 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019622784:0@lo:503: 00000100:00100000:0.0:1788850916.795297:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850916.795325:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a5d0b6a going to sleep for 11 seconds 00000100:00100000:3.0:1788850916.795371:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622784 00000100:00100000:3.0:1788850916.795377:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622784 00000100:00100000:3.0:1788850916.795425:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788850916.795431:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000075004b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019622784:12345-0@lo:503: 00000100:00100000:3.0:1788850916.795516:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000075004b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019622784:12345-0@lo:503: Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850916.795521:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788850916.795705:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a105b68 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019622784:0@lo:503: 00000100:00100000:2.0:1788850916.796116:0:8298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad4a5823 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8298:1875746019622912:0@lo:502: 00000100:00100000:2.0:1788850916.796153:0:8298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850916.796173:0:8298:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026de7985 going to sleep for 11 seconds 00000100:00100000:3.0:1788850916.796257:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622912 00000100:00100000:3.0:1788850916.796262:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622912 00000100:00100000:3.0:1788850916.796294:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788850916.796301:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000947c8695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:8298:x1875746019622912:12345-0@lo:502: 00000100:00100000:3.0:1788850916.796399:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000947c8695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:8298:x1875746019622912:12345-0@lo:502: Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850916.796406:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788850916.796571:0:8298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad4a5823 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8298:1875746019622912:0@lo:502: 00000020:01000000:2.0:1788850916.796593:0:8298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850916.796614:0:8298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850916.796616:0:8298:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788850916.796624:0:8298:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892ebbbf6000 00000020:00000080:2.0:1788850916.796626:0:8298:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788850916.796665:0:8298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8298:1875746019623040:0@lo:502: 00000100:00100000:2.0:1788850916.796715:0:8298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850916.796743:0:8298:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e83764480 going to sleep for 11 seconds 00000100:00100000:3.0:1788850916.796861:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623040 00000100:00100000:3.0:1788850916.796866:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623040 00000100:00100000:3.0:1788850916.796910:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788850916.796919:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:8298:x1875746019623040:12345-0@lo:502: 00000100:00100000:3.0:1788850916.797007:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:8298:x1875746019623040:12345-0@lo:502: Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850916.797091:0:8298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8298:1875746019623040:0@lo:502: 00000020:01000000:2.0:1788850916.797113:0:8298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850916.797119:0:8298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850916.797122:0:8298:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788850916.797126:0:8298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:3.0:1788850916.797712:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:01000000:0.0:1788850916.802209:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788850916.802248:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788850916.802260:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850916.802274:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850916.802285:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788850916.802287:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e91596800 from 1 10000000:01000000:0.0:1788850916.802290:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788850916.802329:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850916.802338:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850916.802349:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850916.802372:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019623168:0@lo:101: 00000100:00100000:0.0:1788850916.803192:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850916.803232:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e915d70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850916.803304:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623168 00000100:00100000:3.0:1788850916.803313:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623168 00000100:00100000:3.0:1788850916.803577:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788850916.803588:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019623168:12345-0@lo:101: 00010000:00010000:3.0:1788850916.803602:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850916.803617:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205673 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850916.803642:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205673 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850916.803653:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205673 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850916.803661:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827eb000, rc 0) 00000100:00100000:3.0:1788850916.803715:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019623168:12345-0@lo:101: Request processed in 129us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850916.803721:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788850916.803855:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019623168:0@lo:101: 00010000:00010000:1.0:1788850916.803870:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850916.803879:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850916.803936:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019623296:0@lo:501: 00000100:00100000:1.0:1788850916.803961:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850916.804088:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850916.804228:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623296 00000100:00100000:2.0:1788850916.804234:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623296 00000100:00100000:2.0:1788850916.804258:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788850916.804265:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019623296:12345-0@lo:501: 00000100:00100000:2.0:1788850916.804384:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019623296:12345-0@lo:501: Request processed in 119us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850916.804403:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788850916.812335:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019623296:0@lo:501: 00000100:00100000:1.0:1788850916.812414:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019623424:0@lo:503: 00000100:00100000:1.0:1788850916.812564:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850916.813146:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850916.815463:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623424 00000100:00100000:2.0:1788850916.815478:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623424 00000100:00100000:2.0:1788850916.815545:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788850916.815556:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019623424:12345-0@lo:503: 00000100:00100000:2.0:1788850916.815713:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019623424:12345-0@lo:503: Request processed in 159us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850916.815721:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788850916.823115:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019623424:0@lo:503: 00000100:00100000:0.0:1788850916.823680:0:8301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8301:1875746019623552:0@lo:502: 00000100:00100000:0.0:1788850916.823763:0:8301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850916.823798:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623552 00000100:00100000:0.0:1788850916.823803:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623552 00000100:00100000:0.0:1788850916.823842:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788850916.823850:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:8301:x1875746019623552:12345-0@lo:502: 00000100:00100000:0.0:1788850916.823951:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:8301:x1875746019623552:12345-0@lo:502: Request processed in 101us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850916.823958:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788850916.824002:0:8301:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e915d7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788850916.824165:0:8301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8301:1875746019623552:0@lo:502: 00000020:01000000:0.0:1788850916.824189:0:8301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850916.824197:0:8301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850916.824199:0:8301:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788850916.824207:0:8301:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892e91596800 00000020:00000080:0.0:1788850916.824209:0:8301:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788850916.824229:0:8301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8301:1875746019623680:0@lo:502: 00000100:00100000:0.0:1788850916.824263:0:8301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850916.824286:0:8301:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e915d7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788850916.824443:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623680 00000100:00100000:2.0:1788850916.824448:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623680 00000100:00100000:2.0:1788850916.824478:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788850916.824549:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:8301:x1875746019623680:12345-0@lo:502: 00000100:00100000:2.0:1788850916.824616:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:8301:x1875746019623680:12345-0@lo:502: Request processed in 131us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850916.824631:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788850916.825653:0:8301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8301:1875746019623680:0@lo:502: 00000020:01000000:0.0:1788850916.825683:0:8301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850916.825689:0:8301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850916.825691:0:8301:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788850916.825695:0:8301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788850916.826125:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788850916.826148:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788850916.826157:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850916.826169:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850917.558482:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850918.587957:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850918.841621:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019623808:0@lo:400: 00000100:00100000:1.0:1788850918.841691:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850918.841736:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019624320:0@lo:400: 00000100:00100000:1.0:1788850918.841761:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850918.841788:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788850918.841794:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019624192:0@lo:400: 00000100:00100000:1.0:1788850918.841817:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850918.841846:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019624064:0@lo:400: 00000100:00100000:1.0:1788850918.841882:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850918.841910:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850918.841915:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019623936:0@lo:400: 00000100:00100000:1.0:1788850918.841939:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850918.841966:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623808 00000100:00100000:1.0:1788850918.841974:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623808 00000100:00100000:1.0:1788850918.842037:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788850918.842046:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:3648:x1875746019623808:12345-0@lo:400: 00000100:00100000:1.0:1788850918.842093:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:3648:x1875746019623808:12345-0@lo:400: Request processed in 48us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850918.842100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788850918.842136:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624320 00000100:00100000:1.0:1788850918.842139:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624320 00000100:00100000:1.0:1788850918.842156:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624064 00000100:00100000:1.0:1788850918.842158:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624064 00000100:00100000:1.0:1788850918.842171:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788850918.842176:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019624320:12345-0@lo:400: 00000100:00100000:1.0:1788850918.842209:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019624320:12345-0@lo:400: Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850918.842215:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788850918.842227:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788850918.842233:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019624064:12345-0@lo:400: 00000100:00100000:1.0:1788850918.842264:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019624064:12345-0@lo:400: Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850918.842270:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788850918.842300:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624192 00000100:00100000:1.0:1788850918.842303:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624192 00000100:00100000:1.0:1788850918.842324:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623936 00000100:00100000:1.0:1788850918.842326:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623936 00000100:00100000:1.0:1788850918.842345:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788850918.842361:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019624192:12345-0@lo:400: 00000100:00100000:1.0:1788850918.842389:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019624192:12345-0@lo:400: Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850918.842394:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788850918.842407:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788850918.842412:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019623936:12345-0@lo:400: 00000100:00100000:1.0:1788850918.842432:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019623936:12345-0@lo:400: Request processed in 21us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850918.842437:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788850918.842481:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e83e18000 x1875746019623936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850918.842494:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019623936:0@lo:400: 00000100:00100000:1.0:1788850918.842503:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019624064:0@lo:400: 00010000:00080000:1.0:1788850918.842529:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e83e19180 x1875746019624192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850918.842538:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019624192:0@lo:400: 00000100:00100000:1.0:1788850918.842546:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019623808:0@lo:400: 00000100:00100000:1.0:1788850918.842553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019624320:0@lo:400: 00000100:00100000:1.0:1788850919.352373:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850919.352401:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019624448:0@lo:41: 00000100:00100000:1.0:1788850919.352470:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850919.352601:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624448 00000100:00100000:0.0:1788850919.352609:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624448 00000100:00100000:0.0:1788850919.352656:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788850919.352665:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019624448:12345-0@lo:41: 00000004:00000024:0.0:1788850919.352697:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788850919.352744:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019624448:12345-0@lo:41: Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.352751:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788850919.363526:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019624448:0@lo:41: 00000020:01000004:3.0:1788850919.533172:0:8441:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788850919.533176:0:8441:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788850919.533178:0:8441:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788850919.533324:0:8441:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892ea5900800 00000020:01000004:3.0:1788850919.533355:0:8441:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788850919.533369:0:8441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788850919.533382:0:8441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff892ead6dcd40) 00000020:00000080:3.0:1788850919.533398:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788850919.604613:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788850919.605185:0:8441:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788850919.605245:0:8441:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788850919.652451:0:8441:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788850919.652692:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788850919.652705:0:8441:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788850919.652717:0:8441:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e0030720b205688 00000020:01000004:2.0:1788850919.652725:0:8441:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788850919.652746:0:8441:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788850919.652749:0:8441:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788850919.652755:0:8441:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788850919.652760:0:8441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788850919.652771:0:8441:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff892eb6f419c0) 00000020:00000080:2.0:1788850919.652782:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788850919.654186:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850919.654370:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788850919.654376:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788850919.657273:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788850919.657290:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788850919.660841:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788850919.660855:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788850919.668784:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788850919.668984:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788850919.668990:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788850919.674545:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788850919.674561:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788850919.729839:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788850919.730119:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788850919.730126:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788850919.732143:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788850919.732157:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788850919.733074:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788850919.733082:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788850919.743870:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850919.744416:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788850919.744425:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788850919.745153:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788850919.745161:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788850919.843689:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788850919.843886:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788850919.843893:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788850919.847415:0:8441:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788850919.847434:0:8441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788850919.849965:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788850919.849997:0:8441:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788850919.850004:0:8441:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788850919.881791:0:8441:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788850919.881828:0:8441:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788850919.881832:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788850919.881834:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788850919.881835:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850919.881837:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850919.881838:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850919.881839:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850919.881840:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850919.881842:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850919.881843:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850919.881845:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850919.881846:0:8441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788850919.881850:0:8441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788850919.881852:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788850919.881853:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788850919.881854:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850919.881855:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850919.881856:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850919.881857:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850919.881858:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850919.881860:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850919.881861:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850919.881862:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850919.881863:0:8441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788850919.881888:0:8441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788850919.881906:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019624576:0@lo:253: 00000100:00100000:1.0:1788850919.881976:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850919.882120:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850919.882170:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624576 00000100:00100000:0.0:1788850919.882178:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624576 00000100:00100000:0.0:1788850919.882264:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788850919.882273:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:8441:x1875746019624576:12345-0@lo:253: 20000000:01000000:0.0:1788850919.882313:0:6529:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788850919.882318:0:6529:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788850919.882322:0:6529:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788850919.882338:0:6529:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788850919.882556:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850919.882700:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788850919.882716:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788850919.882736:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788850919.882751:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788850919.882767:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788850919.882782:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788850919.882864:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788850919.882877:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1788850919.882879:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1788850919.882891:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788850919.882896:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788850919.882907:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788850919.882912:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1788850919.882925:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788850919.882931:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788850919.882943:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788850919.882959:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788850919.883041:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788850919.883052:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1788850919.883054:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1788850919.883081:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788850919.883089:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788850919.883102:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788850919.883107:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1788850919.883119:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788850919.883125:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788850919.883138:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788850919.883153:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788850919.883511:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788850919.883522:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1788850919.883524:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1788850919.883537:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788850919.883543:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788850919.883555:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788850919.883566:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1788850919.883579:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788850919.883584:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788850919.883593:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788850919.883606:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788850919.883617:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788850919.883620:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788850919.883624:0:6529:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788850919.883666:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788850919.883668:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788850919.884496:0:8461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788850919.884538:0:8461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788850919.884556:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788850919.884759:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788850919.884780:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788850919.884801:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788850919.884813:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788850919.884815:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788850919.885402:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788850919.885679:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788850919.885703:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788850919.885734:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788850919.885745:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788850919.885747:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788850919.886151:0:8463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788850919.886174:0:8463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788850919.886187:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788850919.886397:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788850919.886417:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788850919.886431:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788850919.886439:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788850919.886441:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788850919.886903:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788850919.886928:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788850919.886944:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788850919.887070:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788850919.887091:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788850919.887108:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1788850919.887122:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788850919.887142:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887159:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e9eebb200/0x3e0030720b205562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20555b expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887167:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ec2154800/0x3e0030720b2055d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2055d2 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887173:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e827ebe00/0x3e0030720b205611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20560a expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887180:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e827eb600/0x3e0030720b20562d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205626 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887197:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e9eeba200/0x3e0030720b205657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205650 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887205:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887237:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e9eeba200/0x3e0030720b205657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205650 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887251:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e9eeba200/0x3e0030720b205657 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205650 expref: 18 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850919.887344:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019624704:0@lo:104: 00000100:00100000:2.0:1788850919.887408:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850919.887447:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e827eb600/0x3e0030720b20562d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205626 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887455:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e827eb600/0x3e0030720b20562d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205626 expref: 18 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850919.887464:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019624832:0@lo:104: 00000100:00100000:2.0:1788850919.887482:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850919.887503:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e827ebe00/0x3e0030720b205611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b20560a expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887511:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e827ebe00/0x3e0030720b205611 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b20560a expref: 18 pid: 6529 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850919.887518:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019624960:0@lo:104: 00000100:00100000:2.0:1788850919.887779:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850919.887795:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ec2154800/0x3e0030720b2055d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2055d2 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887804:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ec2154800/0x3e0030720b2055d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2055d2 expref: 18 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850919.887812:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019625088:0@lo:104: 00000100:00100000:2.0:1788850919.887827:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850919.887839:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e9eebb200/0x3e0030720b205562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b20555b expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.887847:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e9eebb200/0x3e0030720b205562 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b20555b expref: 18 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850919.887854:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019625216:0@lo:104: 00000100:00100000:2.0:1788850919.887868:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850919.887875:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2416c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850919.887897:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624704 00000100:00100000:2.0:1788850919.887903:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624704 00000100:00100000:2.0:1788850919.887945:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624832 00000100:00100000:2.0:1788850919.887947:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624832 00000100:00100000:2.0:1788850919.887955:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624960 00000100:00100000:2.0:1788850919.887957:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624960 00000100:00100000:2.0:1788850919.887964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625088 00000100:00100000:2.0:1788850919.887966:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625088 00000100:00100000:2.0:1788850919.887973:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625216 00000100:00100000:2.0:1788850919.887975:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625216 00000100:00100000:2.0:1788850919.887986:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788850919.887993:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+7:6529:x1875746019624704:12345-0@lo:104: 00010000:00010000:2.0:1788850919.888004:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888075:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788850919.888081:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+7:6529:x1875746019624704:12345-0@lo:104: Request processed in 89us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.888088:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788850919.888103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788850919.888108:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:6529:x1875746019624832:12345-0@lo:104: 00010000:00010000:2.0:1788850919.888115:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888141:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788850919.888145:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:6529:x1875746019624832:12345-0@lo:104: Request processed in 38us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.888150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788850919.888159:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788850919.888164:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:6529:x1875746019624960:12345-0@lo:104: 00010000:00010000:2.0:1788850919.888171:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20560a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888190:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788850919.888194:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:6529:x1875746019624960:12345-0@lo:104: Request processed in 30us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.888199:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788850919.888208:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788850919.888212:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6529:x1875746019625088:12345-0@lo:104: 00010000:00010000:2.0:1788850919.888218:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b2055d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888243:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788850919.888247:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6529:x1875746019625088:12345-0@lo:104: Request processed in 35us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.888252:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788850919.888376:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788850919.888385:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6529:x1875746019625216:12345-0@lo:104: 00010000:00010000:3.0:1788850919.888394:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b20555b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.888428:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788850919.888433:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6529:x1875746019625216:12345-0@lo:104: Request processed in 51us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850919.888439:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788850919.888601:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788850919.888608:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888615:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebbe00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788850919.888618:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888627:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850919.888635:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850919.888640:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850919.888680:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888687:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788850919.888738:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019625344:0@lo:103: 00000100:00100000:3.0:1788850919.888778:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850919.888885:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205650 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888893:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205657 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888913:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788850919.888917:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888922:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031a00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788850919.888925:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888931:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850919.888938:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850919.888942:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850919.888970:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205626 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888976:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850919.888993:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205626 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.888999:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20562d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889008:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788850919.889037:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20560a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889053:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788850919.889055:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20560a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889062:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20560a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850919.889068:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20560a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850919.889073:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850919.889087:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20560a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889092:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850919.889097:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20560a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889103:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20560a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205611 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889112:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788850919.889115:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b2055d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889121:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eae00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788850919.889124:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b2055d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889139:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b2055d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850919.889146:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b2055d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850919.889151:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850919.889163:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b2055d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889169:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788850919.889213:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019625728:0@lo:103: 00000100:00100000:0.0:1788850919.889241:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850919.889288:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625344 00000100:00100000:0.0:1788850919.889294:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625344 00010000:00010000:0.0:1788850919.889318:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e9eeba200/0x3e0030720b205657 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205650 expref: 19 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850919.889349:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625728 00000100:00100000:0.0:1788850919.889353:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625728 00010000:00010000:0.0:1788850919.889365:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ec2154800/0x3e0030720b2055d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2055d2 expref: 20 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850919.889394:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788850919.889401:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:3650:x1875746019625344:12345-0@lo:103: 00010000:00010000:0.0:1788850919.889412:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850919.889418:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e9eeba200/0x3e0030720b205657 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205650 expref: 20 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.889428:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e9eeba200/0x3e0030720b205657 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205650 expref: 20 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.889443:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788850919.889761:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b2055d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889770:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b2055d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2055d9 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889781:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788850919.889784:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b20555b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889790:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788850919.889793:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b20555b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889801:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b20555b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850919.889808:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b20555b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850919.889820:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850919.889847:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b20555b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889853:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850919.889863:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b20555b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889870:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b20555b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205562 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.889884:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850919.889885:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850919.889887:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850919.889908:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850919.889918:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019625472:0@lo:103: 00000100:00100000:2.0:1788850919.889948:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850919.889962:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850919.889967:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019625600:0@lo:103: 00000100:00100000:2.0:1788850919.889985:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850919.890043:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eeba200/0x3e0030720b205657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205650 expref: 20 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850919.890055:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019624704:0@lo:104: 00000100:00100000:2.0:1788850919.890066:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019624832:0@lo:104: 00000100:00100000:2.0:1788850919.890074:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019624960:0@lo:104: 00000100:00100000:2.0:1788850919.890081:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019625088:0@lo:104: 00000100:00100000:2.0:1788850919.890097:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6529:1875746019625216:0@lo:104: 00010000:00010000:2.0:1788850919.890121:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850919.890519:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:3650:x1875746019625344:12345-0@lo:103: Request processed in 1116us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.890613:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788850919.890633:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625472 00000100:00100000:0.0:1788850919.890638:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625472 00010000:00010000:0.0:1788850919.890655:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e827eb600/0x3e0030720b20562d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205626 expref: 19 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850919.890667:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625600 00000100:00100000:0.0:1788850919.890669:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625600 00010000:00010000:0.0:1788850919.890680:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e827ebe00/0x3e0030720b205611 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20560a expref: 20 pid: 6529 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850919.890694:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788850919.890700:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:3649:x1875746019625728:12345-0@lo:103: 00010000:00010000:0.0:1788850919.890709:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850919.890714:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ec2154800/0x3e0030720b2055d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2055d2 expref: 20 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.890735:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ec2154800/0x3e0030720b2055d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2055d2 expref: 20 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.890747:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2154800/0x3e0030720b2055d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2055d2 expref: 20 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.890758:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850919.890792:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:3649:x1875746019625728:12345-0@lo:103: Request processed in 92us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.890799:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788850919.890857:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788850919.890865:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:3647:x1875746019625472:12345-0@lo:103: 00010000:00010000:0.0:1788850919.890873:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850919.890877:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e827eb600/0x3e0030720b20562d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205626 expref: 18 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.890885:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e827eb600/0x3e0030720b20562d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205626 expref: 18 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.890896:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827eb600/0x3e0030720b20562d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205626 expref: 18 pid: 6528 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.890905:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850919.890940:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3647:x1875746019625472:12345-0@lo:103: Request processed in 76us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.890947:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788850919.890958:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788850919.890964:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:3647:x1875746019625600:12345-0@lo:103: 00010000:00010000:0.0:1788850919.890978:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850919.890982:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e827ebe00/0x3e0030720b205611 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20560a expref: 16 pid: 6529 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.890991:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e827ebe00/0x3e0030720b205611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b20560a expref: 16 pid: 6529 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.891001:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827ebe00/0x3e0030720b205611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b20560a expref: 16 pid: 6529 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.891034:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850919.891057:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:3647:x1875746019625600:12345-0@lo:103: Request processed in 93us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.891063:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788850919.891100:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019625728:0@lo:103: 00000100:00100000:0.0:1788850919.891112:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850919.891118:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019625856:0@lo:103: 00000100:00100000:0.0:1788850919.891143:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850919.891227:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625856 00000100:00100000:1.0:1788850919.891231:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625856 00010000:00010000:1.0:1788850919.891249:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e9eebb200/0x3e0030720b205562 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20555b expref: 15 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850919.891281:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788850919.891287:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:3649:x1875746019625856:12345-0@lo:103: 00010000:00010000:1.0:1788850919.891304:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850919.891308:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e9eebb200/0x3e0030720b205562 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20555b expref: 15 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891317:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e9eebb200/0x3e0030720b205562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b20555b expref: 15 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891336:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebb200/0x3e0030720b205562 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b20555b expref: 15 pid: 6526 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891350:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891358:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891374:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891381:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891388:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891395:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891400:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebac00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788850919.891405:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891422:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891436:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.891445:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850919.891474:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:3649:x1875746019625856:12345-0@lo:103: Request processed in 187us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.891480:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788850919.891795:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019625856:0@lo:103: 00000100:00100000:2.0:1788850919.891870:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019625600:0@lo:103: 00000100:00100000:2.0:1788850919.891878:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019625472:0@lo:103: 00010000:00010000:2.0:1788850919.891897:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.891905:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.891911:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebac00/0x3e0030720b205696 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788850919.891926:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788850919.893934:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:8441:x1875746019624576:12345-0@lo:253: Request processed in 11656us (11951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.893948:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788850919.896438:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019624576:0@lo:253: 10000000:01000000:1.0:1788850919.896459:0:8441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788850919.896462:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788850919.896464:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788850919.896465:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850919.896467:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788850919.896468:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850919.896470:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850919.896471:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850919.896473:0:8441:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788850919.896475:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850919.896476:0:8441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788850919.896503:0:8441:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892ea5900800 from lustre-OST0000 10000000:01000000:1.0:1788850919.896549:0:8441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788850919.896552:0:8441:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788850919.896561:0:8441:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff892ebbbc99c0 local copy 10000000:01000000:1.0:1788850919.896565:0:8441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788850919.896602:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.896614:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.896638:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850919.896656:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019625984:0@lo:101: 00000100:00100000:1.0:1788850919.896709:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850919.896946:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850919.897073:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019625344:0@lo:103: 00000100:00100000:2.0:1788850919.897213:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625984 00000100:00100000:2.0:1788850919.897220:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625984 00000100:00100000:2.0:1788850919.897371:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788850919.897382:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:8441:x1875746019625984:12345-0@lo:101: 00010000:00010000:2.0:1788850919.897396:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850919.897411:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eebbc00/0x3e0030720b2056a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20569d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.897435:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebbc00/0x3e0030720b2056a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20569d expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.897454:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eebbc00/0x3e0030720b2056a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20569d expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.897464:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebbc00, rc 0) 00000100:00100000:2.0:1788850919.897512:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019625984:12345-0@lo:101: Request processed in 132us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.897519:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788850919.897589:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019625984:0@lo:101: 00010000:00010000:3.0:1788850919.897601:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.897623:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850919.897730:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626112:0@lo:501: 00000100:00100000:3.0:1788850919.897757:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.897852:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf540 going to sleep for 11 seconds 00000100:00100000:1.0:1788850919.897888:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626112 00000100:00100000:1.0:1788850919.897892:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626112 00000100:00100000:1.0:1788850919.897912:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788850919.897918:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626112:12345-0@lo:501: 00000100:00100000:1.0:1788850919.898062:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626112:12345-0@lo:501: Request processed in 143us (303us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788850919.898069:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788850919.898189:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626112:0@lo:501: 10000000:01000000:3.0:1788850919.898202:0:8441:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788850919.898218:0:8441:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788850919.898223:0:8441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.898231:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.898239:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.898264:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788850919.898288:0:8441:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892ea5900800 10000000:01000000:3.0:1788850919.898292:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788850919.898296:0:8441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788850919.898299:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788850919.898302:0:8441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788850919.898305:0:8441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788850919.898320:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.898348:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.898356:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850919.898368:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626240:0@lo:101: 00000100:00100000:3.0:1788850919.898392:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850919.898439:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788850919.898445:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.898452:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788850919.898456:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.898464:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850919.898471:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850919.898477:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850919.898495:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.898501:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850919.898518:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.898536:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff95600/0x3e0030720b20569d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e0030720b2056a4 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.898548:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850919.898550:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850919.898552:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850919.898559:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788850919.898569:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019626368:0@lo:103: 00000100:00100000:2.0:1788850919.898597:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.898720:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788850919.898769:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626368 00000100:00100000:0.0:1788850919.898773:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626368 00000100:00100000:0.0:1788850919.899045:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850919.899054:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:3648:x1875746019626368:12345-0@lo:103: 00010000:00010000:0.0:1788850919.899064:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850919.899075:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebbc00/0x3e0030720b2056a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b20569d expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.899089:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850919.899130:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:3648:x1875746019626368:12345-0@lo:103: Request processed in 78us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.899137:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788850919.899191:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019626368:0@lo:103: 00000100:00100000:1.0:1788850919.899269:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626240 00000100:00100000:1.0:1788850919.899273:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626240 00000100:00100000:1.0:1788850919.899293:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788850919.899298:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+13:8441:x1875746019626240:12345-0@lo:101: 00010000:00010000:1.0:1788850919.899306:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850919.899317:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2056ab expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.899345:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2056ab expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.899355:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2056ab expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.899361:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94e00, rc 0) 00000100:00100000:1.0:1788850919.899397:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626240:12345-0@lo:101: Request processed in 99us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.899404:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788850919.899477:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626240:0@lo:101: 00010000:00010000:3.0:1788850919.899488:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.899496:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850919.899571:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626496:0@lo:501: 00000100:00100000:3.0:1788850919.899595:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.899620:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788850919.899760:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626496 00000100:00100000:1.0:1788850919.899765:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626496 00000100:00100000:1.0:1788850919.899797:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788850919.899803:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626496:12345-0@lo:501: 00000100:00100000:1.0:1788850919.899896:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626496:12345-0@lo:501: Request processed in 92us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.899902:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788850919.899974:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626496:0@lo:501: 00000100:00100000:3.0:1788850919.899998:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626624:0@lo:503: 00000100:00100000:3.0:1788850919.900064:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.900080:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788850919.900136:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626624 00000100:00100000:1.0:1788850919.900140:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626624 00000100:00100000:1.0:1788850919.900170:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788850919.900176:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626624:12345-0@lo:503: 00000100:00100000:1.0:1788850919.900248:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626624:12345-0@lo:503: Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.900267:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788850919.900407:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626624:0@lo:503: 00000040:00080000:3.0:1788850919.900711:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788850919.900780:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626752:0@lo:502: 00000100:00100000:3.0:1788850919.900819:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.900850:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788850919.900902:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626752 00000100:00100000:1.0:1788850919.900907:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626752 00000100:00100000:1.0:1788850919.900938:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788850919.900944:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626752:12345-0@lo:502: 00000100:00100000:1.0:1788850919.901039:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626752:12345-0@lo:502: Request processed in 94us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.901045:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788850919.901125:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626752:0@lo:502: 00000040:00080000:3.0:1788850919.901414:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788850919.901442:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788850919.901456:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788850919.901468:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788850919.901481:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788850919.901492:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788850919.901512:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626880:0@lo:502: 00000100:00100000:3.0:1788850919.901611:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.901641:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788850919.901699:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626880 00000100:00100000:1.0:1788850919.901704:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626880 00000100:00100000:1.0:1788850919.901734:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788850919.901741:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626880:12345-0@lo:502: 00000100:00100000:1.0:1788850919.901816:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019626880:12345-0@lo:502: Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.901823:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788850919.901903:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019626880:0@lo:502: 00000040:00080000:3.0:1788850919.901937:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788850919.901945:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788850919.902709:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788850919.902719:0:8465:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788850919.902725:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850919.902727:0:8465:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788850919.902734:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788850919.902762:0:8465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff892d85c63380) 00000020:00000080:2.0:1788850919.902786:0:8465:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788850919.902794:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788850919.902867:0:8465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892ea5900800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788850919.902874:0:8465:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788850919.902885:0:8465:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e0030720b2056c0 00010000:00010000:2.0:1788850919.909439:0:8465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788850919.909829:0:8465:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788850919.912863:0:8465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788850919.913352:0:8465:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788850919.917657:0:8465:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788850919.917844:0:8465:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788850919.927151:0:8465:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788850919.929538:0:8465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788850919.929550:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850919.929562:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850919.929564:0:8465:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788850919.929568:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850919.929575:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850919.929577:0:8465:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788850919.929579:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788850919.929581:0:8465:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788850919.929606:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850919.929610:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850919.929611:0:8465:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788850919.929614:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788850919.931169:0:8441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788850919.931206:0:8441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788850919.932391:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.932410:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850919.932526:0:8441:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea5900800 from 1 10000000:01000000:2.0:1788850919.932530:0:8441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788850919.932570:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.932579:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.932591:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850919.932617:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627008:0@lo:101: 00000100:00100000:2.0:1788850919.932691:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850919.932744:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850919.932801:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627008 00000100:00100000:0.0:1788850919.932809:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627008 00000100:00100000:0.0:1788850919.932859:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788850919.932868:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:8441:x1875746019627008:12345-0@lo:101: 00010000:00010000:0.0:1788850919.932880:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850919.932891:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2056c7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.932913:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2056c7 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.932923:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2056c7 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850919.932931:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031600, rc 0) 00000100:00100000:0.0:1788850919.932970:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627008:12345-0@lo:101: Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.932976:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788850919.933106:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627008:0@lo:101: 00010000:00010000:2.0:1788850919.933120:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.933128:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850919.933232:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627136:0@lo:501: 00000100:00100000:2.0:1788850919.933348:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850919.933377:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850919.933424:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627136 00000100:00100000:0.0:1788850919.933429:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627136 00000100:00100000:0.0:1788850919.933460:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788850919.933467:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627136:12345-0@lo:501: 00000100:00100000:0.0:1788850919.933556:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627136:12345-0@lo:501: Request processed in 89us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.933563:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788850919.934409:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627136:0@lo:501: 00000100:00100000:2.0:1788850919.934447:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627264:0@lo:503: 00000100:00100000:2.0:1788850919.934494:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850919.934522:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850919.934588:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627264 00000100:00100000:0.0:1788850919.934593:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627264 00000100:00100000:0.0:1788850919.934631:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788850919.934638:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627264:12345-0@lo:503: 00000100:00100000:0.0:1788850919.934730:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627264:12345-0@lo:503: Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.934737:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788850919.934809:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627264:0@lo:503: 00000040:00080000:2.0:1788850919.935056:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788850919.935129:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627392:0@lo:502: 00000100:00100000:2.0:1788850919.935163:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850919.935186:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850919.935237:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627392 00000100:00100000:0.0:1788850919.935241:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627392 00000100:00100000:0.0:1788850919.935278:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788850919.935284:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627392:12345-0@lo:502: 00000100:00100000:0.0:1788850919.935365:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627392:12345-0@lo:502: Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.935372:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788850919.935507:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627392:0@lo:502: 00000040:00080000:2.0:1788850919.935678:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788850919.935703:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788850919.935722:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627520:0@lo:502: 00000100:00100000:2.0:1788850919.935754:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850919.935779:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850919.935819:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627520 00000100:00100000:0.0:1788850919.935824:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627520 00000100:00100000:0.0:1788850919.935883:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788850919.935890:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627520:12345-0@lo:502: 00000100:00100000:0.0:1788850919.935956:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627520:12345-0@lo:502: Request processed in 66us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.935972:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788850919.938122:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627520:0@lo:502: 00000040:00080000:1.0:1788850919.938217:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788850919.938230:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788850919.943918:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788850919.943933:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788850919.943935:0:8469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788850919.943942:0:8469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892ea5900800 00000020:00000080:3.0:1788850919.943945:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788850919.943957:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788850919.943960:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788850919.943962:0:8469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788850919.943965:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788850919.944299:0:8441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788850919.944342:0:8441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788850919.944356:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.944369:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850919.944423:0:8441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788850919.944427:0:8441:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892ea5900800 10000000:01000000:1.0:1788850919.944430:0:8441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892ea5900800 10000000:01000000:1.0:1788850919.944434:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788850919.944440:0:8441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ea5900800 from 1 10000000:01000000:1.0:1788850919.944443:0:8441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788850919.944479:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.944489:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.944500:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850919.944523:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627648:0@lo:101: 00000100:00100000:1.0:1788850919.944603:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850919.944649:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850919.944806:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627648 00000100:00100000:2.0:1788850919.944814:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627648 00000100:00100000:2.0:1788850919.944860:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788850919.944870:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8441:x1875746019627648:12345-0@lo:101: 00010000:00010000:2.0:1788850919.944884:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850919.944896:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2056d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.944928:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2056d5 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.944939:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2056d5 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850919.944948:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eeba200, rc 0) 00000100:00100000:2.0:1788850919.944993:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019627648:12345-0@lo:101: Request processed in 124us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.945000:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788850919.945193:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627648:0@lo:101: 00010000:00010000:1.0:1788850919.945206:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.945215:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850919.945427:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627776:0@lo:501: 00000100:00100000:1.0:1788850919.945455:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850919.945482:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788850919.945529:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627776 00000100:00100000:0.0:1788850919.945534:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627776 00000100:00100000:0.0:1788850919.945566:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788850919.945573:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019627776:12345-0@lo:501: 00000100:00100000:0.0:1788850919.945675:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019627776:12345-0@lo:501: Request processed in 102us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.945682:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788850919.945769:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627776:0@lo:501: 00000100:00100000:1.0:1788850919.945793:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627904:0@lo:503: 00000100:00100000:1.0:1788850919.945831:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850919.945850:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788850919.945890:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627904 00000100:00100000:0.0:1788850919.945894:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627904 00000100:00100000:0.0:1788850919.945923:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788850919.945929:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019627904:12345-0@lo:503: 00000100:00100000:0.0:1788850919.946006:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019627904:12345-0@lo:503: Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850919.946041:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788850919.946504:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019627904:0@lo:503: 00000040:00080000:1.0:1788850919.946729:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788850919.946793:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019628032:0@lo:502: 00000100:00100000:1.0:1788850919.946828:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850919.946859:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850919.946908:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628032 00000100:00100000:2.0:1788850919.946913:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628032 00000100:00100000:2.0:1788850919.946938:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788850919.946945:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019628032:12345-0@lo:502: 00000100:00100000:2.0:1788850919.947058:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019628032:12345-0@lo:502: Request processed in 112us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.947065:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788850919.947209:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019628032:0@lo:502: 00000040:00080000:1.0:1788850919.947424:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788850919.947449:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788850919.947462:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788850919.947475:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788850919.947498:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788850919.947514:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788850919.947528:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788850919.947540:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788850919.947552:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788850919.947565:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788850919.947580:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788850919.947593:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788850919.947604:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788850919.947615:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788850919.947627:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788850919.947639:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788850919.947664:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788850919.947679:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788850919.947692:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788850919.947704:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788850919.947716:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788850919.947728:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788850919.947741:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788850919.947754:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788850919.947767:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788850919.947779:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788850919.947792:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788850919.947805:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788850919.947818:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788850919.947828:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788850919.947840:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788850919.947850:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788850919.947875:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788850919.947888:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788850919.947898:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788850919.947908:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788850919.947917:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788850919.947944:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019628160:0@lo:502: 00000100:00100000:1.0:1788850919.947986:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850919.948067:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850919.948366:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628160 00000100:00100000:2.0:1788850919.948372:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628160 00000100:00100000:2.0:1788850919.948402:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788850919.948410:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019628160:12345-0@lo:502: 00000100:00100000:2.0:1788850919.948506:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019628160:12345-0@lo:502: Request processed in 96us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.948513:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788850919.948634:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019628160:0@lo:502: 00000040:00080000:1.0:1788850919.948678:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788850919.948686:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788850919.949443:0:8470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788850919.949469:0:8470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff892d85f219c0) 00000020:00000080:3.0:1788850919.949492:0:8470:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788850919.949570:0:8470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892ea5900800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788850919.949574:0:8470:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ea5900800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788850919.949576:0:8470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea5900800 3 00010000:00080000:3.0:1788850919.949604:0:8470:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d85c51800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1788850919.951891:0:8470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788850919.952132:0:8470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788850919.952170:0:8470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788850919.952183:0:8470:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3e0030720b2056ea 00000100:00080000:3.0:1788850919.954726:0:8470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788850919.954741:0:8470:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff892d85c51800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788850919.954778:0:8470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e85695880 x1875746019628288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788850919.954835:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019628288:0@lo:38: 00000100:00100000:2.0:1788850919.954904:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788850919.954975:0:8470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788850919.955060:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628288 00000100:00100000:1.0:1788850919.955068:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628288 00000100:00100000:1.0:1788850919.955115:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788850919.955122:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019628288:12345-0@lo:38: 00010000:00080000:1.0:1788850919.955149:0:6535:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1788850919.955180:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e0030720b2056f1 00000004:00100000:1.0:1788850919.955197:0:6535:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788850919.955226:0:6535:0:(import.c:65:import_set_state_nolock()) ffff892ea568f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788850919.960453:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875746019628288:12345-0@lo:38: Request processed in 5321us (5539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.960468:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850919.964223:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019628544:0@lo:400: 00000100:00100000:1.0:1788850919.964403:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019628800:0@lo:400: 00000100:00100000:0.0:1788850919.964495:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019628416:0@lo:400: 00000100:00100000:1.0:1788850919.964987:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788850919.965168:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e85695880 x1875746019628288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788850929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850919.965180:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788850919.965190:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788850919.965198:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788850919.965204:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788850919.965208:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788850919.965214:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019628288:0@lo:38: 00000100:00100000:3.0:1788850919.965242:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.965379:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788850919.965387:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019628672:0@lo:400: 00000100:00100000:3.0:1788850919.965413:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.965452:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628672 00000100:00100000:3.0:1788850919.965459:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628672 00000100:00100000:3.0:1788850919.965511:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788850919.965520:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019628672:12345-0@lo:400: 00000100:00100000:3.0:1788850919.965571:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019628672:12345-0@lo:400: Request processed in 52us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850919.965578:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788850919.965609:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e85697800 x1875746019628672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850919.965619:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019628672:0@lo:400: 00000020:01000004:3.0:1788850919.965716:0:8470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788850919.965730:0:8470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff892d85f23380) 00000020:00000080:3.0:1788850919.965750:0:8470:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788850919.965842:0:8470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892ea5900800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788850919.965846:0:8470:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ea5900800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788850919.965848:0:8470:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea5900800 3 00010000:00080000:3.0:1788850919.965874:0:8470:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d85c53800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.127@tcp at head 00000100:00100000:0.0:1788850919.967587:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850919.968315:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628416 00000100:00100000:2.0:1788850919.968334:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628416 00000100:00100000:2.0:1788850919.968380:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788850919.968389:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019628416:12345-0@lo:400: 00000100:00100000:2.0:1788850919.968451:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019628416:12345-0@lo:400: Request processed in 64us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.968459:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788850919.968497:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e85696d80 x1875746019628416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850919.968511:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019628416:0@lo:400: 00010000:00010000:3.0:1788850919.968778:0:8470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1788850919.968963:0:8470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788850919.969000:0:8470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788850919.969032:0:8470:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x3e0030720b2056ff 00000100:00080000:3.0:1788850919.969039:0:8470:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788850919.969047:0:8470:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff892d85c53800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788850919.969075:0:8470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e85697800 x1875746019628928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788850919.969093:0:8470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788850919.969222:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628800 00000100:00100000:1.0:1788850919.969228:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628800 00000100:00100000:1.0:1788850919.969251:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628544 00000100:00100000:1.0:1788850919.969254:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628544 00000100:00100000:1.0:1788850919.969281:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788850919.969288:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019628800:12345-0@lo:400: 00000100:00100000:1.0:1788850919.969348:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019628800:12345-0@lo:400: Request processed in 60us (4361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.969364:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788850919.969378:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788850919.969385:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019628544:12345-0@lo:400: 00000100:00100000:1.0:1788850919.969425:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019628544:12345-0@lo:400: Request processed in 40us (4183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.969431:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788850919.969460:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019628800:0@lo:400: 00000100:00100000:3.0:1788850919.969631:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019628544:0@lo:400: 00000100:00100000:2.0:1788850919.969721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019628928:0@lo:38: 00000100:00100000:2.0:1788850919.969763:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850919.969886:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628928 00000100:00100000:2.0:1788850919.969890:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628928 00000100:00100000:2.0:1788850919.969908:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788850919.969913:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019628928:12345-0@lo:38: 00010000:00080000:2.0:1788850919.969944:0:6534:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:2.0:1788850919.969971:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x3e0030720b205706 00000004:00100000:2.0:1788850919.969988:0:6534:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788850919.970040:0:6534:0:(import.c:65:import_set_state_nolock()) ffff892eb6c27800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788850919.970074:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875746019628928:12345-0@lo:38: Request processed in 160us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.970080:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788850919.970103:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e85697800 x1875746019628928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788850929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850919.970112:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788850919.970117:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788850919.970123:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788850919.970128:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788850919.970131:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c53800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788850919.970136:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019628928:0@lo:38: 00000040:00080000:3.0:1788850919.972267:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788850919.973470:0:8441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788850919.973506:0:8441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788850919.973563:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.973575:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788850919.973630:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788850919.973632:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788850919.973634:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850919.973635:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850919.973636:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850919.973638:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850919.973639:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850919.973640:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850919.973641:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850919.973643:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850919.973644:0:8441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788850919.973648:0:8441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788850919.973650:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788850919.973651:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788850919.973652:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850919.973653:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850919.973659:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850919.973660:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850919.973660:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850919.973661:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850919.973662:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850919.973663:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850919.973663:0:8441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788850919.973689:0:8441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788850919.973707:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019629056:0@lo:253: 00000100:00100000:1.0:1788850919.973774:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850919.973820:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850919.975413:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629056 00000100:00100000:2.0:1788850919.975425:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629056 00000100:00100000:2.0:1788850919.975481:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788850919.975490:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019629056:12345-0@lo:253: 20000000:01000000:2.0:1788850919.975518:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788850919.975546:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788850919.980433:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788850919.980458:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788850919.980844:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:8441:x1875746019629056:12345-0@lo:253: Request processed in 5349us (7065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850919.980856:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788850919.980923:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:8441:1875746019629056:0@lo:253: 10000000:01000000:2.0:1788850919.980936:0:8441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788850919.980940:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788850919.980953:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788850919.980954:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788850919.980955:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788850919.980956:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788850919.980957:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788850919.980959:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788850919.980960:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788850919.980962:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788850919.980963:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788850919.980965:0:8441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788850919.980980:0:8441:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788850919.983780:0:6550:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788850919.983791:0:6550:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788850919.983823:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.983842:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80031800/0x3e0030720b205603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2055fc expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.983850:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e9eebb000/0x3e0030720b20561f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205618 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.983857:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.983900:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e9eebb000/0x3e0030720b20561f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205618 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.983915:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e9eebb000/0x3e0030720b20561f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205618 expref: 15 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850919.983929:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019629184:0@lo:104: 00000100:00100000:1.0:1788850919.983998:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788850919.984095:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80031800/0x3e0030720b205603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2055fc expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.984116:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e80031800/0x3e0030720b205603 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2055fc expref: 15 pid: 6528 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850919.984126:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019629312:0@lo:104: 00000100:00100000:1.0:1788850919.984148:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788850919.984299:0:6518:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788850919.984318:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.984361:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629184 00000100:00100000:3.0:1788850919.984369:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629184 00000100:00100000:3.0:1788850919.984403:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629312 00000100:00100000:3.0:1788850919.984407:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629312 00000100:00100000:3.0:1788850919.984423:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788850919.984432:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea567d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6550:x1875746019629184:12345-0@lo:104: 00010000:00010000:3.0:1788850919.984445:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984508:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788850919.984514:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea567d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6550:x1875746019629184:12345-0@lo:104: Request processed in 83us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850919.984521:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788850919.984553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788850919.984559:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6550:x1875746019629312:12345-0@lo:104: 00010000:00010000:3.0:1788850919.984566:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b2055fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984592:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788850919.984597:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6550:x1875746019629312:12345-0@lo:104: Request processed in 39us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850919.984602:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788850919.984616:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788850919.984621:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984628:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788850919.984632:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984641:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788850919.984647:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850919.984653:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788850919.984687:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984693:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788850919.984711:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205618 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984717:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20561f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984731:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788850919.984734:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b2055fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984739:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788850919.984742:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b2055fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984748:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b2055fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788850919.984755:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b2055fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850919.984760:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788850919.984770:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b2055fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984776:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788850919.984789:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b2055fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984806:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b2055fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205603 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.984819:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850919.984821:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850919.984822:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850919.984829:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850919.984840:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019629440:0@lo:103: 00000100:00100000:3.0:1788850919.984867:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.984904:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019629568:0@lo:103: 00000100:00100000:3.0:1788850919.984927:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850919.984955:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629440 00000100:00100000:3.0:1788850919.984959:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629440 00010000:00010000:3.0:1788850919.984974:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e9eebb000/0x3e0030720b20561f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205618 expref: 16 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850919.984992:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629568 00000100:00100000:3.0:1788850919.984995:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629568 00010000:00010000:3.0:1788850919.985004:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80031800/0x3e0030720b205603 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2055fc expref: 17 pid: 6528 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850919.985057:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788850919.985064:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3648:x1875746019629440:12345-0@lo:103: 00010000:00010000:3.0:1788850919.985074:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850919.985078:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e9eebb000/0x3e0030720b20561f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205618 expref: 17 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.985089:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e9eebb000/0x3e0030720b20561f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205618 expref: 17 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850919.986115:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788850919.986132:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3649:x1875746019629568:12345-0@lo:103: 00010000:00010000:1.0:1788850919.986145:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850919.986151:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80031800/0x3e0030720b205603 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2055fc expref: 17 pid: 6528 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788850919.987640:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788850919.987820:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00010000:00010000:1.0:1788850919.988473:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80031800/0x3e0030720b205603 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2055fc expref: 17 pid: 6528 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850919.988499:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850919.988577:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3649:x1875746019629568:12345-0@lo:103: Request processed in 2451us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850919.988588:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788850919.988648:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019629184:0@lo:104: 00010000:00010000:1.0:1788850919.988660:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031800/0x3e0030720b205603 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2055fc expref: 16 pid: 6528 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850919.988672:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019629312:0@lo:104: 00010000:00010000:1.0:1788850919.988697:0:6550:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788850919.988925:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788850919.989247:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788850919.989788:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788850919.989995:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788850919.991800:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788850919.991939:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebb000/0x3e0030720b20561f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205618 expref: 15 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.991961:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.991971:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788850919.991990:0:6520:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010869659s 00010000:00010000:3.0:1788850919.991997:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.992003:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.992033:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.992042:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.992048:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788850919.992052:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.992061:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.992079:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.992266:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850919.992355:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:3648:x1875746019629440:12345-0@lo:103: Request processed in 7290us (7485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850919.992366:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788850919.992508:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019629440:0@lo:103: 00000100:00100000:2.0:1788850919.993206:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019629568:0@lo:103: 00010000:00010000:3.0:1788850919.994391:0:6550:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.994408:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850919.994416:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff95200/0x3e0030720b20570d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788850920.000624:0:8441:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788850920.000634:0:8441:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788850920.000678:0:8441:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788850920.000724:0:8441:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788850920.000742:0:8441:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788850920.000759:0:8441:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788850920.007534:0:8441:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788850920.007719:0:8441:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788850920.630351:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788850921.145884:0:8526:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788850921.146647:0:8526:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788850921.405206:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019629696:0@lo:41: 00000100:00100000:3.0:1788850921.405332:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850921.405433:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629696 00000100:00100000:3.0:1788850921.405443:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629696 00000100:00100000:3.0:1788850921.405501:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788850921.405512:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019629696:12345-0@lo:41: 00000004:00000024:3.0:1788850921.405560:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788850921.405619:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019629696:12345-0@lo:41: Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850921.405627:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788850921.405685:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019629696:0@lo:41: 00010000:00010000:0.0:1788850921.655174:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850922.680250:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788850923.125109:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788850923.125129:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ebbbf6000 from 30 10000000:01000000:0.0:1788850923.125136:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788850923.125201:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.125216:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.125230:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850923.125260:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019629824:0@lo:101: 00000100:00100000:0.0:1788850923.125366:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.125443:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.125731:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629824 00000100:00100000:2.0:1788850923.125743:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629824 00000100:00100000:2.0:1788850923.125804:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788850923.125814:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:6531:x1875746019629824:12345-0@lo:101: 00010000:00010000:2.0:1788850923.125832:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850923.125849:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205714 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.125880:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205714 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.125908:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205714 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.125918:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebbe00, rc 0) 00000100:00100000:2.0:1788850923.125977:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019629824:12345-0@lo:101: Request processed in 164us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.125984:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788850923.126203:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019629824:0@lo:101: 00010000:00010000:0.0:1788850923.126225:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.126235:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850923.126330:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019629952:0@lo:501: 00000100:00100000:0.0:1788850923.126364:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.126408:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.126549:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629952 00000100:00100000:2.0:1788850923.126556:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629952 00000100:00100000:2.0:1788850923.126594:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788850923.126603:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019629952:12345-0@lo:501: 00000100:00100000:2.0:1788850923.126756:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019629952:12345-0@lo:501: Request processed in 153us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.126763:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788850923.126989:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019629952:0@lo:501: 00000100:00100000:0.0:1788850923.127052:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630080:0@lo:503: 00000100:00100000:0.0:1788850923.127293:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.127327:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.127389:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630080 00000100:00100000:2.0:1788850923.127394:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630080 00000100:00100000:2.0:1788850923.127429:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788850923.127437:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019630080:12345-0@lo:503: 00000100:00100000:2.0:1788850923.127551:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019630080:12345-0@lo:503: Request processed in 113us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.127558:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788850923.127715:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630080:0@lo:503: 00000100:00100000:0.0:1788850923.132621:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8606:1875746019630208:0@lo:502: 00000100:00100000:0.0:1788850923.132740:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.132798:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.135156:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630208 00000100:00100000:2.0:1788850923.135176:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630208 00000100:00100000:2.0:1788850923.135257:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788850923.135278:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8606:x1875746019630208:12345-0@lo:502: 00000100:00100000:2.0:1788850923.135513:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8606:x1875746019630208:12345-0@lo:502: Request processed in 246us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.135528:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788850923.136350:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8606:1875746019630208:0@lo:502: 00000100:00100000:0.0:1788850923.146538:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8606:1875746019630336:0@lo:502: 00000100:00100000:1.0:1788850923.146963:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.147034:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630336 00000100:00100000:2.0:1788850923.147046:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630336 00000100:00100000:1.0:1788850923.147048:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.147113:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788850923.147126:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8606:x1875746019630336:12345-0@lo:502: 00000100:00100000:2.0:1788850923.147335:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:8606:x1875746019630336:12345-0@lo:502: Request processed in 212us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.147344:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788850923.147446:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8606:1875746019630336:0@lo:502: 00000040:00080000:1.0:1788850923.147488:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788850923.147711:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788850923.147737:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788850923.147749:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.147762:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850923.147774:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788850923.147777:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892ebbbf6000 from 5 10000000:01000000:0.0:1788850923.147780:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788850923.147822:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.147831:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.147841:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850923.147859:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630464:0@lo:101: 00000100:00100000:0.0:1788850923.147898:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.147940:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788850923.148300:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630464 00000100:00100000:1.0:1788850923.148308:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630464 00000100:00100000:1.0:1788850923.148361:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788850923.148370:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019630464:12345-0@lo:101: 00010000:00010000:1.0:1788850923.148382:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850923.148400:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205722 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.148426:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205722 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.148437:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205722 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.148447:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94400, rc 0) 00000100:00100000:1.0:1788850923.148485:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019630464:12345-0@lo:101: Request processed in 116us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.148491:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788850923.148501:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630464:0@lo:101: 00010000:00010000:0.0:1788850923.148516:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.148527:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850923.148577:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630592:0@lo:256: 00000100:00100000:0.0:1788850923.148611:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.148641:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788850923.148951:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630592 00000100:00100000:1.0:1788850923.148956:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630592 00000100:00100000:1.0:1788850923.148991:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788850923.148998:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019630592:12345-0@lo:256: 20000000:01000000:1.0:1788850923.149036:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788850923.149061:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788850923.149065:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788850923.149154:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019630592:12345-0@lo:256: Request processed in 155us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.149161:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788850923.149174:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630592:0@lo:256: 10000000:01000000:0.0:1788850923.149228:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788850923.149235:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.149244:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850923.149253:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788850923.149256:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788850923.149259:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788850923.149290:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.149298:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.149306:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850923.149326:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630720:0@lo:101: 00000100:00100000:0.0:1788850923.149354:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.149393:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630720 00000100:00100000:0.0:1788850923.149396:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788850923.149398:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630720 00000100:00100000:1.0:1788850923.149418:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788850923.149425:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019630720:12345-0@lo:101: 00010000:00010000:1.0:1788850923.149434:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850923.149445:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205730 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.149461:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205730 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.149470:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205730 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.149478:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94a00, rc 0) 00000100:00100000:1.0:1788850923.149515:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019630720:12345-0@lo:101: Request processed in 90us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.149521:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788850923.149554:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630720:0@lo:101: 00010000:00010000:0.0:1788850923.149566:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.149574:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850923.149635:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630848:0@lo:501: 00000100:00100000:0.0:1788850923.149664:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.149686:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788850923.149954:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630848 00000100:00100000:1.0:1788850923.149960:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630848 00000100:00100000:1.0:1788850923.149991:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788850923.149997:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019630848:12345-0@lo:501: 00000100:00100000:1.0:1788850923.150165:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019630848:12345-0@lo:501: Request processed in 168us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850923.150190:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630848:0@lo:501: 00000100:00100000:0.0:1788850923.150223:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630976:0@lo:503: 00000100:00100000:0.0:1788850923.150274:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.150302:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788850923.150349:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630976 00000100:00100000:3.0:1788850923.150359:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630976 00000100:00100000:3.0:1788850923.150532:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788850923.150541:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019630976:12345-0@lo:503: 00000100:00100000:3.0:1788850923.150626:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019630976:12345-0@lo:503: Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850923.150633:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788850923.152039:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788850923.152195:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019630976:0@lo:503: 00000100:00100000:0.0:1788850923.152584:0:8608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8608:1875746019631104:0@lo:502: 00000100:00100000:0.0:1788850923.152653:0:8608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.152689:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631104 00000100:00100000:0.0:1788850923.152696:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631104 00000100:00100000:0.0:1788850923.152731:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788850923.152739:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:8608:x1875746019631104:12345-0@lo:502: 00000100:00100000:0.0:1788850923.152876:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:8608:x1875746019631104:12345-0@lo:502: Request processed in 137us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850923.152883:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788850923.152943:0:8608:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788850923.152958:0:8608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8608:1875746019631104:0@lo:502: 00000020:01000000:0.0:1788850923.152982:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788850923.152991:0:8608:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788850923.152999:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850923.153002:0:8608:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788850923.153007:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788850923.153043:0:8608:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:0.0:1788850923.153072:0:8608:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788850923.153075:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788850923.153096:0:8608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff892ebbbccd40) 00000020:00000080:0.0:1788850923.153124:0:8608:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788850923.153129:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788850923.153244:0:8608:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788850923.153251:0:8608:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788850923.153261:0:8608:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b205745 00010000:00080000:0.0:1788850923.153311:0:8608:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892ead290000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788850923.153577:0:8608:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788850923.165929:0:8608:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788850923.165960:0:8608:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788850923.166501:0:8608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850923.166774:0:8608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850923.166876:0:8608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788850923.166977:0:8608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788850923.169590:0:8610:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788850923.169600:0:8610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788850923.173366:0:8608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788850923.173386:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788850923.173449:0:8608:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788850923.173481:0:8608:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b20574c 00000100:00080000:0.0:1788850923.173495:0:8608:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788850923.173509:0:8608:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff892ead290000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788850923.173558:0:8608:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e83e15c00 x1875746019631232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788850923.173592:0:8608:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788850923.173615:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019631232:0@lo:8: 00000020:01000000:0.0:1788850923.173682:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850923.173686:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850923.173700:0:8608:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788850923.173705:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850923.173711:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850923.173713:0:8608:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788850923.173716:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788850923.173718:0:8608:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788850923.173752:0:8608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8608:1875746019631488:0@lo:502: 00000100:00100000:1.0:1788850923.173827:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019631360:0@lo:400: 00000100:00100000:0.0:1788850923.183461:0:8608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.183526:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.183538:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631488 00000100:00100000:0.0:1788850923.183551:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631488 00000100:00100000:1.0:1788850923.183593:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019632000:0@lo:400: 00000100:00100000:0.0:1788850923.183626:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788850923.183640:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:8608:x1875746019631488:12345-0@lo:502: 00000100:00100000:0.0:1788850923.183821:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:8608:x1875746019631488:12345-0@lo:502: Request processed in 184us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.183944:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.183978:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788850923.183985:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019631616:0@lo:400: 00000100:00100000:1.0:1788850923.184097:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.184118:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019632128:0@lo:400: 00000100:00100000:1.0:1788850923.184145:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.184178:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019631744:0@lo:400: 00000100:00100000:1.0:1788850923.184208:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.184225:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788850923.184344:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019631872:0@lo:400: 00000100:00100000:1.0:1788850923.184432:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.184528:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631360 00000100:00100000:1.0:1788850923.184535:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631360 00000100:00100000:1.0:1788850923.184573:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632000 00000100:00100000:1.0:1788850923.184576:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632000 00000100:00100000:1.0:1788850923.184610:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632128 00000100:00100000:1.0:1788850923.184613:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632128 00000100:00080000:3.0:1788850923.184624:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788850923.185578:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631744 00000100:00100000:1.0:1788850923.185586:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631744 00000100:00100000:1.0:1788850923.185604:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788850923.185612:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019631360:12345-0@lo:400: 00000100:00100000:1.0:1788850923.186055:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019631360:12345-0@lo:400: Request processed in 442us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.186083:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788850923.186104:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788850923.186111:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019632000:12345-0@lo:400: 00000100:00100000:1.0:1788850923.186141:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019632000:12345-0@lo:400: Request processed in 31us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.186147:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788850923.186159:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788850923.186165:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019632128:12345-0@lo:400: 00000100:00100000:1.0:1788850923.186193:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019632128:12345-0@lo:400: Request processed in 28us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.186198:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788850923.186210:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788850923.186216:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019631744:12345-0@lo:400: 00000100:00100000:1.0:1788850923.186321:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019631744:12345-0@lo:400: Request processed in 104us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.186328:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788850923.186357:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631616 00000100:00100000:1.0:1788850923.186362:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631616 00000100:00100000:1.0:1788850923.186382:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631872 00000100:00100000:2.0:1788850923.186391:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.186392:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631872 00000100:00100000:1.0:1788850923.186416:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788850923.186426:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019631616:12345-0@lo:400: 00000100:00100000:1.0:1788850923.186531:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019631616:12345-0@lo:400: Request processed in 46us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.186538:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788850923.186658:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788850923.186672:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019631872:12345-0@lo:400: 00000100:00100000:1.0:1788850923.186704:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019631872:12345-0@lo:400: Request processed in 32us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.186710:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788850923.186735:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788850923.186830:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019631616:0@lo:400: 00010000:00080000:1.0:1788850923.186845:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5997b80 x1875746019632128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850923.186855:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019632128:0@lo:400: 00010000:00080000:1.0:1788850923.186936:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5997100 x1875746019631360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850923.186946:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019631360:0@lo:400: 00010000:00080000:1.0:1788850923.186955:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5996300 x1875746019632000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850923.186963:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019632000:0@lo:400: 00000100:00100000:1.0:1788850923.187003:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019631872:0@lo:400: 00010000:00080000:1.0:1788850923.187054:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5996a00 x1875746019631744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850923.187062:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019631744:0@lo:400: 00000100:00100000:0.0:1788850923.187221:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788850923.187301:0:8608:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850923.187317:0:8608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8608:1875746019631488:0@lo:502: 00000020:01000000:0.0:1788850923.187345:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850923.187358:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850923.187360:0:8608:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788850923.187376:0:8608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1788850923.187672:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788850923.187697:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788850923.187707:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.187730:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850923.187855:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788850923.187916:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892e91596800 from 30 10000000:01000000:1.0:1788850923.187920:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788850923.187951:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.187960:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.187969:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850923.187987:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019632256:0@lo:101: 00000100:00100000:1.0:1788850923.188051:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.188078:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850923.188225:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632256 00000100:00100000:0.0:1788850923.188232:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632256 00000100:00100000:3.0:1788850923.188273:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631232 00000100:00100000:3.0:1788850923.188286:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631232 00000100:00100000:0.0:1788850923.188294:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788850923.188307:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019632256:12345-0@lo:101: 00010000:00010000:0.0:1788850923.188319:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850923.188336:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205753 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850923.188346:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850923.188360:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019631232:12345-0@lo:8: 00010000:00010000:0.0:1788850923.188373:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205753 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.188388:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205753 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.188399:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030800, rc 0) 00000100:00100000:0.0:1788850923.188462:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019632256:12345-0@lo:101: Request processed in 157us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850923.188470:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788850923.188714:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019632256:0@lo:101: 00010000:00010000:1.0:1788850923.188729:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850923.188739:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788850923.188959:0:8447:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788850923.188997:0:8447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b205761 00000100:00100000:1.0:1788850923.189448:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019632384:0@lo:501: 00000100:00100000:1.0:1788850923.189484:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.189529:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2bcc0 going to sleep for 11 seconds 00002000:00100000:3.0:1788850923.189581:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff892d85c53000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788850923.189589:0:8447:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788850923.189595:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788850923.189611:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632384 00000100:00100000:0.0:1788850923.189618:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632384 00000100:00100000:0.0:1788850923.189663:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788850923.189674:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019632384:12345-0@lo:501: 00002000:00100000:3.0:1788850923.189696:0:8447:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788850923.189804:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019632384:12345-0@lo:501: Request processed in 132us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850923.189812:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788850923.189902:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019632384:0@lo:501: 00002000:00080000:3.0:1788850923.189993:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1788850923.190218:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019632512:0@lo:503: 00000100:00100000:1.0:1788850923.190276:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.190331:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850923.190366:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632512 00000100:00100000:0.0:1788850923.190376:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632512 00000100:00100000:0.0:1788850923.190438:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788850923.190445:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019632512:12345-0@lo:503: 00000100:00100000:0.0:1788850923.190520:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019632512:12345-0@lo:503: Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850923.190528:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788850923.190580:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019632512:0@lo:503: 00000100:00080000:3.0:1788850923.190622:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892d85c54000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850923.190709:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875746019631232:12345-0@lo:8: Request processed in 2347us (4326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850923.190721:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788850923.190791:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8612:1875746019632640:0@lo:502: 00000100:00100000:1.0:1788850923.190844:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.190874:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850923.190887:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632640 00000100:00100000:0.0:1788850923.190892:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632640 00000100:00100000:0.0:1788850923.190925:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788850923.190936:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:8612:x1875746019632640:12345-0@lo:502: 00000100:00100000:0.0:1788850923.191290:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:8612:x1875746019632640:12345-0@lo:502: Request processed in 358us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850923.191298:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788850923.191317:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8612:1875746019632640:0@lo:502: 00000100:00100000:1.0:1788850923.191364:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8612:1875746019632768:0@lo:502: 00000100:00100000:1.0:1788850923.191405:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.191437:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850923.191489:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632768 00000100:00100000:0.0:1788850923.191493:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632768 00000100:00100000:0.0:1788850923.191554:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788850923.191561:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:8612:x1875746019632768:12345-0@lo:502: 00000100:00100000:0.0:1788850923.191630:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:8612:x1875746019632768:12345-0@lo:502: Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850923.191636:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788850923.191696:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8612:1875746019632768:0@lo:502: 00000040:00080000:1.0:1788850923.191714:0:8612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788850923.191850:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788850923.191874:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788850923.191883:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.191894:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850923.191914:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788850923.191916:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e91596800 from 5 10000000:01000000:0.0:1788850923.191919:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788850923.191956:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.191965:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.191974:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850923.191989:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019632896:0@lo:101: 00000100:00100000:0.0:1788850923.192068:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.192090:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788850923.192104:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632896 00000100:00100000:0.0:1788850923.192108:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632896 00000100:00100000:0.0:1788850923.192148:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1788850923.192171:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e15c00 x1875746019631232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788850933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850923.192289:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019632896:12345-0@lo:101: 00010000:00010000:0.0:1788850923.192299:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850923.192312:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205768 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850923.192334:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205768 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850923.192382:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00010000:00010000:0.0:1788850923.192385:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205768 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788850923.192396:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788850923.192408:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788850923.192416:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788850923.192421:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ead290000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788850923.192446:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788850923.192456:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019631232:0@lo:8: 00000100:00100000:1.0:1788850923.192480:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8611:1875746019633024:0@lo:700: 00010000:00010000:0.0:1788850923.192486:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031400, rc 0) 00000100:00100000:1.0:1788850923.192510:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850923.192525:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019632896:12345-0@lo:101: Request processed in 242us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.192526:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850923.192530:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788850923.192550:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633024 00000100:00100000:1.0:1788850923.192554:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633024 00000004:00080000:0.0:1788850923.192575:0:8610:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788850923.192581:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019632896:0@lo:101: 00000100:00100000:1.0:1788850923.192601:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788850923.192608:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850923.192615:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8611:x1875746019633024:12345-0@lo:700: 00010000:00010000:2.0:1788850923.192643:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788850923.192649:0:8610:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 257251635224ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788850923.192655:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8456:1875746019633152:0@lo:700: 00080000:00080000:0.0:1788850923.192656:0:8610:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788850923.192685:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.192709:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2b840 going to sleep for 11 seconds 00000100:00080000:1.0:1788850923.192725:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788850923.192737:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019633280:0@lo:256: 00000100:00100000:2.0:1788850923.192834:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.192878:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788850923.193055:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633280 00000100:00100000:1.0:1788850923.193063:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633280 00000100:00100000:1.0:1788850923.193112:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788850923.193124:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019633280:12345-0@lo:256: 00000100:00100000:0.0:1788850923.193141:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633152 20000000:01000000:1.0:1788850923.193146:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00100000:0.0:1788850923.193150:0:6541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633152 20000000:01000000:1.0:1788850923.193171:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788850923.193186:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788850923.193191:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850923.193204:0:6541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8456:x1875746019633152:12345-0@lo:700: 00000100:00100000:1.0:1788850923.193310:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019633280:12345-0@lo:256: Request processed in 185us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.193319:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788850923.193484:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019633280:0@lo:256: 10000000:01000000:2.0:1788850923.193535:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788850923.193543:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.193553:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850923.193562:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788850923.193565:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788850923.193568:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788850923.193592:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.193600:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.193609:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850923.193623:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019633408:0@lo:101: 00000100:00100000:2.0:1788850923.193650:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.193683:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.193697:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633408 00000100:00100000:2.0:1788850923.193706:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633408 00000100:00100000:2.0:1788850923.193736:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788850923.193743:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019633408:12345-0@lo:101: 00010000:00010000:2.0:1788850923.193765:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850923.193777:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205776 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.193799:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205776 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.193810:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205776 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.193820:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebb200, rc 0) 00000100:00100000:2.0:1788850923.193858:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019633408:12345-0@lo:101: Request processed in 116us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.193864:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788850923.193892:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019633408:0@lo:101: 00010000:00010000:2.0:1788850923.193903:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.193911:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850923.193970:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019633536:0@lo:501: 00000100:00100000:2.0:1788850923.193994:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.194046:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.194057:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633536 00000100:00100000:2.0:1788850923.194060:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633536 00000100:00100000:2.0:1788850923.194083:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788850923.194089:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019633536:12345-0@lo:501: 00000100:00100000:2.0:1788850923.194225:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019633536:12345-0@lo:501: Request processed in 136us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.194232:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788850923.194260:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019633536:0@lo:501: 00000100:00100000:2.0:1788850923.194302:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019633664:0@lo:503: 00000100:00100000:2.0:1788850923.194344:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.194357:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.194368:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633664 00000100:00100000:2.0:1788850923.194371:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633664 00000100:00100000:2.0:1788850923.194389:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788850923.194394:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019633664:12345-0@lo:503: 00000100:00100000:2.0:1788850923.194478:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019633664:12345-0@lo:503: Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.194485:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788850923.194521:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019633664:0@lo:503: 00000100:00100000:3.0:1788850923.196666:0:8614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85696d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8614:1875746019633792:0@lo:502: 00000100:00100000:3.0:1788850923.196784:0:8614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850923.196829:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633792 00000100:00100000:3.0:1788850923.196836:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633792 00000100:00100000:3.0:1788850923.196886:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788850923.196902:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:8614:x1875746019633792:12345-0@lo:502: 00000100:00100000:3.0:1788850923.200664:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:8614:x1875746019633792:12345-0@lo:502: Request processed in 3748us (3865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850923.200683:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788850923.200773:0:8614:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850923.200807:0:8614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85696d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8614:1875746019633792:0@lo:502: 00000020:01000000:3.0:1788850923.200851:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788850923.200861:0:8614:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788850923.200870:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788850923.200873:0:8614:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788850923.200879:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788850923.200884:0:8614:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1788850923.200914:0:8614:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788850923.200916:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788850923.200936:0:8614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff892d85f24d40) 00000020:00000080:3.0:1788850923.200964:0:8614:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788850923.200969:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788850923.202077:0:8614:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788850923.202335:0:8614:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788850923.202349:0:8614:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b20578b 00010000:00080000:3.0:1788850923.202406:0:8614:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892ea5b98800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.127@tcp at head 00000004:00080000:1.0:1788850923.203227:0:7465:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:3.0:1788850923.204246:0:8614:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:2.0:1788850923.211110:0:8614:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788850923.211136:0:8614:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788850923.211417:0:8614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788850923.213417:0:8614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788850923.213534:0:8614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788850923.213616:0:8614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788850923.213962:0:8617:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788850923.213967:0:8617:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 40000000:02000000:3.0:1788850923.214258:0:6541:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:00000080:2.0:1788850923.214898:0:8614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788850923.214913:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788850923.214969:0:8614:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788850923.215002:0:8614:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b205792 00000100:00080000:2.0:1788850923.215116:0:8614:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788850923.215137:0:8614:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff892ea5b98800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788850923.215179:0:8614:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e8a5e0380 x1875746019633920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788850923.215297:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019633920:0@lo:8: 00000100:00100000:0.0:1788850923.215368:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788850923.215425:0:8614:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788850923.215526:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850923.215530:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850923.215532:0:8614:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788850923.215535:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850923.215538:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850923.215540:0:8614:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788850923.215542:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788850923.215544:0:8614:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788850923.215569:0:8614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8614:1875746019634048:0@lo:502: 00000100:00100000:2.0:1788850923.215614:0:8614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.215633:0:8614:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.216071:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634048 00000100:00100000:2.0:1788850923.216080:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634048 00000100:00100000:2.0:1788850923.216123:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788850923.216132:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:8614:x1875746019634048:12345-0@lo:502: 00000100:00100000:2.0:1788850923.216287:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:8614:x1875746019634048:12345-0@lo:502: Request processed in 155us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.216295:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788850923.216346:0:8614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:8614:1875746019634048:0@lo:502: 00000020:01000000:2.0:1788850923.216371:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850923.216376:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850923.216378:0:8614:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788850923.216382:0:8614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1788850923.217359:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633920 00000100:00100000:1.0:1788850923.217375:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633920 00000100:00100000:1.0:1788850923.217435:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788850923.217444:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875746019633920:12345-0@lo:8: 00010000:00080000:1.0:1788850923.217484:0:8450:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1788850923.217524:0:8450:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b205799 00002000:00100000:1.0:1788850923.217543:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff892ea4304000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788850923.217548:0:8450:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788850923.217552:0:8450:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:2.0:1788850923.218084:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788850923.218126:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788850923.218149:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.218161:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850923.218172:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788850923.218175:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff892ebbbc99c0 from 1 10000000:01000000:2.0:1788850923.218178:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788850923.218210:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.218218:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.218229:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850923.218248:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019634176:0@lo:101: 00000100:00100000:2.0:1788850923.218317:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.218355:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9e40 going to sleep for 11 seconds 00002000:00080000:1.0:1788850923.224775:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788850923.224833:0:8450:0:(import.c:65:import_set_state_nolock()) ffff892ea576b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788850923.224990:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875746019633920:12345-0@lo:8: Request processed in 7541us (9617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.225005:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788850923.225109:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e8a5e0380 x1875746019633920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788850933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850923.225123:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788850923.225132:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788850923.225141:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788850923.225147:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788850923.225150:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5b98800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788850923.225300:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788850923.225323:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019633920:0@lo:8: 00000004:00080000:1.0:1788850923.226303:0:8617:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788850923.227073:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634176 00000100:00100000:2.0:1788850923.227084:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634176 00000100:00100000:2.0:1788850923.227132:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788850923.227141:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019634176:12345-0@lo:101: 00010000:00010000:2.0:1788850923.227154:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850923.227178:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2057a0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.227202:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2057a0 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.227212:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2057a0 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.227220:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827ea000, rc 0) 00000100:00100000:2.0:1788850923.227301:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019634176:12345-0@lo:101: Request processed in 161us (8984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.227307:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788850923.227371:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019634176:0@lo:101: 00010000:00010000:2.0:1788850923.227388:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.227397:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850923.227458:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019634304:0@lo:501: 00000100:00100000:2.0:1788850923.227486:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.227580:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850923.235743:0:6541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8456:x1875746019633152:12345-0@lo:700: Request processed in 42531us (43045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850923.235761:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788850923.235849:0:8456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5996300 x1875746019633152/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850923.235887:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8456:1875746019633152:0@lo:700: 40000000:02000000:3.0:1788850923.235905:0:8456:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1788850923.240185:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634304 00000100:00100000:1.0:1788850923.240201:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634304 00000004:00080000:1.0:1788850923.240294:0:8617:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 257299280423ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788850923.240304:0:8617:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788850923.240395:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788850923.240836:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019634304:12345-0@lo:501: 00000100:00100000:1.0:1788850923.240965:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019634304:12345-0@lo:501: Request processed in 134us (13477us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788850923.243126:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788850923.243308:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019634304:0@lo:501: 10000000:01000000:2.0:1788850923.243391:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788850923.243404:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850923.243418:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850923.245992:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019634432:0@lo:13: 00000100:00100000:2.0:1788850923.246290:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.246540:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634432 00000100:00100000:2.0:1788850923.246551:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634432 00000100:00100000:2.0:1788850923.246623:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850923.246634:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019634432:12345-0@lo:13: 00002000:00000024:2.0:1788850923.246669:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788850923.246724:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019634432:12345-0@lo:13: Request processed in 92us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.246732:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788850923.246756:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788850923.246794:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5991180 x1875746019634432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850923.246816:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019634432:0@lo:13: 00000004:00080000:2.0:1788850923.248276:0:8618:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788850923.248329:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8618:1875746019634560:0@lo:7: 00000100:00100000:2.0:1788850923.248397:0:8618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.248433:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9e40 going to sleep for 11 seconds 00000004:00080000:2.0:1788850923.251026:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788850923.252239:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634560 00000100:00100000:1.0:1788850923.252256:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634560 00000100:00100000:1.0:1788850923.252416:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788850923.252430:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8618:x1875746019634560:12345-0@lo:7: 00002000:00080000:1.0:1788850923.258324:0:8447:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788850923.258336:0:8447:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788850923.258462:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8618:x1875746019634560:12345-0@lo:7: Request processed in 6029us (10058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.258476:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788850923.266290:0:8618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5991180 x1875746019634560/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850923.266543:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8618:1875746019634560:0@lo:7: 00000004:00080000:2.0:1788850923.266569:0:8618:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788850923.266627:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8618:1875746019634688:0@lo:5: 00000100:00100000:2.0:1788850923.266711:0:8618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.266949:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850923.279202:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634688 00000100:00100000:3.0:1788850923.279225:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634688 00000100:00100000:2.0:1788850923.280237:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850923.280252:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8618:x1875746019634688:12345-0@lo:5: 00002000:00080000:2.0:1788850923.280311:0:8450:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788850923.280317:0:8450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00100000:2.0:1788850923.283392:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788850923.283409:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788850923.283621:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8611:x1875746019633024:12345-0@lo:700: Request processed in 90995us (91093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850923.283650:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788850923.283679:0:8611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5996a00 x1875746019633024/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850923.283697:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8611:1875746019633024:0@lo:700: 00000100:00100000:2.0:1788850923.298553:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019634816:0@lo:13: 00000100:00100000:2.0:1788850923.298649:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850923.298744:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634816 00000100:00100000:2.0:1788850923.298765:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634816 00000100:00100000:2.0:1788850923.298823:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850923.299010:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019634816:12345-0@lo:13: 00002000:00000024:2.0:1788850923.299060:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788850923.299186:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019634816:12345-0@lo:13: Request processed in 353us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.299205:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788850923.299276:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5997b80 x1875746019634816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850923.299302:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019634816:0@lo:13: 00000004:00080000:1.0:1788850923.299392:0:8611:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788850923.299425:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8611:1875746019634944:0@lo:7: 00000100:00100000:1.0:1788850923.299459:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.299491:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e98353780 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.300871:0:8447:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788850923.300888:0:8447:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000001:00080000:2.0:1788850923.301233:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1788850923.302186:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8618:x1875746019634688:12345-0@lo:5: Request processed in 21929us (35466us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788850923.302200:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850923.302239:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634944 00000100:00100000:2.0:1788850923.302250:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634944 00000100:00100000:2.0:1788850923.305268:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788850923.305301:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8611:x1875746019634944:12345-0@lo:7: 00010000:00080000:3.0:1788850923.311478:0:8618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5991180 x1875746019634688/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850923.311496:0:8618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788850923.311505:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8618:1875746019634688:0@lo:5: 00000004:00080000:3.0:1788850923.311527:0:8618:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788850923.311599:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85696d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8618:1875746019635072:0@lo:700: 00000100:00100000:3.0:1788850923.311687:0:8618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850923.311759:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635072 00000100:00100000:3.0:1788850923.311767:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635072 00000100:00100000:3.0:1788850923.311830:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788850923.311842:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8618:x1875746019635072:12345-0@lo:700: 00000100:00100000:3.0:1788850923.313364:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9dc00 going to sleep for 11 seconds 00002000:00080000:2.0:1788850923.319656:0:8449:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788850923.319668:0:8449:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788850923.319940:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8611:x1875746019634944:12345-0@lo:7: Request processed in 14647us (20473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850923.319953:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788850923.324991:0:8611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5995180 x1875746019634944/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850923.325039:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8611:1875746019634944:0@lo:7: 00000004:00080000:1.0:1788850923.325061:0:8611:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788850923.325123:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8611:1875746019635200:0@lo:5: 00000100:00100000:1.0:1788850923.325222:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.325272:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788850923.325510:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635200 00000100:00100000:3.0:1788850923.325519:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635200 00000100:00100000:3.0:1788850923.325585:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850923.325596:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8611:x1875746019635200:12345-0@lo:5: 00002000:00080000:3.0:1788850923.325635:0:8450:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788850923.325698:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8611:x1875746019635200:12345-0@lo:5: Request processed in 104us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850923.325712:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788850923.325757:0:8611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5995180 x1875746019635200/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850923.325768:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8611:1875746019635200:0@lo:5: 00000004:00080000:3.0:1788850923.325789:0:8611:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788850923.325821:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8611:1875746019635328:0@lo:5: 00000100:00100000:3.0:1788850923.326198:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850923.326227:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788850923.326246:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635328 00000100:00100000:3.0:1788850923.326251:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635328 00000100:00100000:3.0:1788850923.326297:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850923.326305:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8611:x1875746019635328:12345-0@lo:5: 00002000:00080000:3.0:1788850923.326340:0:8450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788850923.344799:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8611:x1875746019635328:12345-0@lo:5: Request processed in 18485us (18592us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788850923.344815:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788850923.344958:0:8611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e85695180 x1875746019635328/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850923.344980:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8611:1875746019635328:0@lo:5: 00000004:00080000:1.0:1788850923.345000:0:8611:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788850923.345077:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8611:1875746019635456:0@lo:900: 00000100:00100000:1.0:1788850923.345127:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.345156:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850923.345188:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635456 00000100:00100000:1.0:1788850923.345196:0:6546:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635456 00000100:00100000:1.0:1788850923.345241:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788850923.345250:0:6546:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8611:x1875746019635456:12345-0@lo:900: 00000100:00100000:1.0:1788850923.345312:0:6546:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8611:x1875746019635456:12345-0@lo:900: Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.345320:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788850923.345350:0:8611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5995180 x1875746019635456/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850923.345360:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8611:1875746019635456:0@lo:900: 00000001:00080000:3.0:1788850923.360450:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1788850923.360848:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8618:x1875746019635072:12345-0@lo:700: Request processed in 49000us (49154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850923.360873:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788850923.361147:0:8618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e85696d80 x1875746019635072/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850923.361170:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85696d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8618:1875746019635072:0@lo:700: 00000004:02000040:3.0:1788850923.372563:0:8618:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788850923.387290:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8618:1875746019635584:0@lo:5: 00000100:00100000:3.0:1788850923.387391:0:8618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850923.387469:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850923.391204:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635584 00000100:00100000:2.0:1788850923.391228:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635584 00000100:00100000:2.0:1788850923.391345:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788850923.391358:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8618:x1875746019635584:12345-0@lo:5: 00002000:00080000:3.0:1788850923.424960:0:8625:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788850923.424999:0:8625:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788850923.430521:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8618:x1875746019635584:12345-0@lo:5: Request processed in 39155us (43119us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788850923.430553:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788850923.430604:0:8618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c56d80 x1875746019635584/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850939 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850923.430625:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8618:1875746019635584:0@lo:5: 00000004:00080000:1.0:1788850923.430644:0:8618:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1788850923.700721:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850924.472394:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788850924.472432:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019635712:0@lo:41: 00000100:00100000:3.0:1788850924.472643:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850924.472834:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635712 00000100:00100000:2.0:1788850924.472854:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635712 00000100:00100000:2.0:1788850924.472921:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788850924.472931:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019635712:12345-0@lo:41: 00000004:00000024:2.0:1788850924.472974:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788850924.473065:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019635712:12345-0@lo:41: Request processed in 135us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850924.473073:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788850924.473173:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019635712:0@lo:41: 00010000:00010000:3.0:1788850924.726630:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850925.748748:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850926.518401:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788850926.518439:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019635840:0@lo:41: 00000100:00100000:3.0:1788850926.518544:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850926.518648:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635840 00000100:00100000:3.0:1788850926.518658:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635840 00000100:00100000:3.0:1788850926.518723:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788850926.518734:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019635840:12345-0@lo:41: 00000004:00000024:3.0:1788850926.518780:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788850926.521239:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019635840:12345-0@lo:41: Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850926.521270:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788850926.521402:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019635840:0@lo:41: 00010000:00010000:3.0:1788850926.772930:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850927.586789:0:8825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788850927.796539:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788850928.502203:0:8877:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788850928.502446:0:8877:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788850928.565301:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019635968:0@lo:13: 00000100:00100000:2.0:1788850928.565375:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.565437:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019636480:0@lo:400: 00000100:00100000:2.0:1788850928.565461:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.565479:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019636992:0@lo:400: 00000100:00100000:2.0:1788850928.565498:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.565521:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788850928.565527:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019636096:0@lo:400: 00000100:00100000:2.0:1788850928.565553:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.565799:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019636608:0@lo:400: 00000100:00100000:2.0:1788850928.565839:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.565867:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019637120:0@lo:400: 00000100:00100000:2.0:1788850928.565890:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.565931:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019636224:0@lo:400: 00000100:00100000:2.0:1788850928.565953:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.565970:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019636736:0@lo:400: 00000100:00100000:2.0:1788850928.565988:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.566004:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788850928.566009:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019636352:0@lo:400: 00000100:00100000:2.0:1788850928.566061:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.566079:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019636864:0@lo:400: 00000100:00100000:2.0:1788850928.566097:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850928.566124:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635968 00000100:00100000:2.0:1788850928.566131:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635968 00000100:00100000:2.0:1788850928.566194:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788850928.566205:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019635968:12345-0@lo:13: 00002000:00000024:2.0:1788850928.566237:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850928.566279:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019635968:12345-0@lo:13: Request processed in 76us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850928.566285:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788850928.566306:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636480 00000100:00100000:2.0:1788850928.566309:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636480 00000100:00100000:2.0:1788850928.566325:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636224 00000100:00100000:2.0:1788850928.566328:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636224 00000100:00100000:2.0:1788850928.566337:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636736 00000100:00100000:2.0:1788850928.566338:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636736 00000100:00100000:2.0:1788850928.566348:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636864 00000100:00100000:2.0:1788850928.566350:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636864 00000100:00100000:2.0:1788850928.566363:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788850928.566369:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019636480:12345-0@lo:400: 00000100:00100000:2.0:1788850928.566550:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019636480:12345-0@lo:400: Request processed in 180us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850928.566557:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788850928.566690:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636608 00000100:00100000:1.0:1788850928.566694:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636608 00000100:00100000:1.0:1788850928.566712:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636352 00000100:00100000:1.0:1788850928.566714:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636352 00000100:00100000:1.0:1788850928.566725:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788850928.566730:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019636608:12345-0@lo:400: 00000100:00100000:1.0:1788850928.566765:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019636608:12345-0@lo:400: Request processed in 35us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850928.566771:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788850928.566781:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788850928.566786:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019636352:12345-0@lo:400: 00000100:00100000:1.0:1788850928.566814:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019636352:12345-0@lo:400: Request processed in 28us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850928.566820:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788850928.566858:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788850928.566866:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019636224:12345-0@lo:400: 00000100:00100000:2.0:1788850928.566891:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019636224:12345-0@lo:400: Request processed in 28us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850928.566906:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788850928.566919:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850928.566925:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019636736:12345-0@lo:400: 00000100:00100000:2.0:1788850928.566951:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019636736:12345-0@lo:400: Request processed in 28us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850928.566957:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850928.566966:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788850928.566972:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019636864:12345-0@lo:400: 00000100:00100000:2.0:1788850928.566993:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019636864:12345-0@lo:400: Request processed in 22us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850928.566998:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788850928.567642:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636992 00000100:00100000:2.0:1788850928.567649:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636992 00000100:00100000:2.0:1788850928.567684:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637120 00000100:00100000:2.0:1788850928.567688:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637120 00000100:00100000:2.0:1788850928.567711:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850928.567717:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019636992:12345-0@lo:400: 00000100:00100000:2.0:1788850928.567756:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019636992:12345-0@lo:400: Request processed in 39us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850928.567762:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850928.567774:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850928.567780:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019637120:12345-0@lo:400: 00000100:00100000:2.0:1788850928.567805:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019637120:12345-0@lo:400: Request processed in 26us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850928.567810:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850928.567830:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636096 00000100:00100000:2.0:1788850928.567841:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636096 00000100:00100000:2.0:1788850928.567869:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788850928.567875:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:3649:x1875746019636096:12345-0@lo:400: 00000100:00100000:2.0:1788850928.567907:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:3649:x1875746019636096:12345-0@lo:400: Request processed in 32us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850928.567912:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788850928.567954:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788850928.567958:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788850928.567961:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788850928.567998:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019636352:0@lo:400: 00000100:00100000:1.0:1788850928.568270:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788850928.568284:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019637248:0@lo:13: 00000100:00100000:1.0:1788850928.568322:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850928.568471:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637248 00000100:00100000:3.0:1788850928.568477:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637248 00000100:00100000:3.0:1788850928.568513:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850928.568520:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019637248:12345-0@lo:13: 00002000:00000024:3.0:1788850928.568545:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850928.568663:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019637248:12345-0@lo:13: Request processed in 143us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850928.568670:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788850928.568738:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c57480 x1875746019637248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850928.568755:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019637248:0@lo:13: 00010000:00080000:2.0:1788850928.569075:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5993b80 x1875746019636864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850928.569089:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019636864:0@lo:400: 00010000:00080000:2.0:1788850928.569105:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5992680 x1875746019636224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850928.569114:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019636224:0@lo:400: 00010000:00080000:2.0:1788850928.569123:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5993800 x1875746019636736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850928.569129:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019636736:0@lo:400: 00000100:00100000:2.0:1788850928.569174:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019636096:0@lo:400: 00000100:00100000:2.0:1788850928.569185:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019636608:0@lo:400: 00010000:00080000:2.0:1788850928.569194:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5993100 x1875746019637120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850928.569203:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019637120:0@lo:400: 00010000:00080000:2.0:1788850928.569224:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5990380 x1875746019635968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850928.569232:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788850928.569246:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019635968:0@lo:13: 00010000:00080000:2.0:1788850928.569258:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5991880 x1875746019636480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850928.569265:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019636480:0@lo:400: 00010000:00080000:2.0:1788850928.569274:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5990000 x1875746019636992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850928.569281:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019636992:0@lo:400: 00010000:00010000:3.0:1788850928.820328:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788850929.091235:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788850929.588287:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850929.588315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019637376:0@lo:41: 00000100:00100000:2.0:1788850929.588384:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850929.588650:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637376 00000100:00100000:1.0:1788850929.588658:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637376 00000100:00100000:1.0:1788850929.588709:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788850929.588730:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019637376:12345-0@lo:41: 00000004:00000024:1.0:1788850929.588766:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788850929.589063:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019637376:12345-0@lo:41: Request processed in 345us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850929.589087:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850929.589193:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019637376:0@lo:41: 00010000:00010000:1.0:1788850929.845864:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850930.868183:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788850931.339853:0:8978:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788850931.340064:0:8978:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788850931.636403:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019637504:0@lo:41: 00000100:00100000:1.0:1788850931.636476:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850931.636625:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637504 00000100:00100000:3.0:1788850931.636633:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637504 00000100:00100000:3.0:1788850931.636680:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788850931.636690:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019637504:12345-0@lo:41: 00000004:00000024:3.0:1788850931.636723:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788850931.636777:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019637504:12345-0@lo:41: Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850931.636785:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788850931.636861:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019637504:0@lo:41: 00010000:00010000:2.0:1788850931.892444:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788850932.245531:0:9026:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788850932.245546:0:9026:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788850932.917030:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850933.684225:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850933.684252:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019637632:0@lo:13: 00000100:00100000:2.0:1788850933.684324:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850933.684386:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637632 00000100:00100000:2.0:1788850933.684394:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637632 00000100:00100000:2.0:1788850933.684451:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788850933.684462:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019637632:12345-0@lo:13: 00002000:00000024:2.0:1788850933.684508:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850933.684551:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019637632:12345-0@lo:13: Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850933.684558:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788850933.684579:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788850933.684609:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5ad6680 x1875746019637632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850933.684625:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019637632:0@lo:13: 00000100:00100000:3.0:1788850933.684858:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019637888:0@lo:400: 00000100:00100000:3.0:1788850933.684889:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850933.684906:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019638400:0@lo:400: 00000100:00100000:3.0:1788850933.684923:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850933.684938:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788850933.684943:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019637760:0@lo:400: 00000100:00100000:3.0:1788850933.684969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850933.685001:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019638272:0@lo:400: 00000100:00100000:3.0:1788850933.685045:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850933.685083:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638272 00000100:00100000:3.0:1788850933.685087:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638272 00000100:00100000:3.0:1788850933.685126:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788850933.685132:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019638272:12345-0@lo:400: 00000100:00100000:3.0:1788850933.685170:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019638272:12345-0@lo:400: Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850933.685177:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788850933.685209:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019638144:0@lo:400: 00000100:00100000:3.0:1788850933.685232:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850933.685247:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019638656:0@lo:400: 00000100:00100000:3.0:1788850933.685266:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850933.685282:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788850933.685287:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019638016:0@lo:400: 00000100:00100000:3.0:1788850933.685307:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850933.685322:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019638528:0@lo:400: 00000100:00100000:3.0:1788850933.685345:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850933.685362:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638016 00000100:00100000:3.0:1788850933.685365:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638016 00000100:00100000:3.0:1788850933.685386:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788850933.685392:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019638016:12345-0@lo:400: 00000100:00100000:3.0:1788850933.685424:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019638016:12345-0@lo:400: Request processed in 32us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850933.685430:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788850933.685456:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019638016:0@lo:400: 00000100:00100000:3.0:1788850933.685476:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019638272:0@lo:400: 00000100:00100000:2.0:1788850933.685598:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637888 00000100:00100000:2.0:1788850933.685603:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637888 00000100:00100000:2.0:1788850933.685624:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638400 00000100:00100000:2.0:1788850933.685626:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638400 00000100:00100000:2.0:1788850933.685650:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638144 00000100:00100000:2.0:1788850933.685653:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638144 00000100:00100000:2.0:1788850933.685662:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638528 00000100:00100000:2.0:1788850933.685664:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638528 00000100:00100000:2.0:1788850933.685678:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788850933.685684:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019637888:12345-0@lo:400: 00000100:00100000:2.0:1788850933.685729:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019637888:12345-0@lo:400: Request processed in 45us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850933.685735:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788850933.685748:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850933.685755:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019638400:12345-0@lo:400: 00000100:00100000:2.0:1788850933.685783:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019638400:12345-0@lo:400: Request processed in 29us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850933.685789:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850933.685800:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788850933.685806:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019638144:12345-0@lo:400: 00000100:00100000:2.0:1788850933.685845:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019638144:12345-0@lo:400: Request processed in 40us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850933.685851:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788850933.685863:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788850933.685870:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019638528:12345-0@lo:400: 00000100:00100000:2.0:1788850933.685896:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019638528:12345-0@lo:400: Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850933.685902:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788850933.685925:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638656 00000100:00100000:2.0:1788850933.685928:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638656 00000100:00100000:2.0:1788850933.685952:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788850933.685958:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019638656:12345-0@lo:400: 00000100:00100000:2.0:1788850933.686003:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019638656:12345-0@lo:400: Request processed in 45us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850933.686009:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788850933.686158:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c55c00 x1875746019638528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850933.686168:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019638528:0@lo:400: 00010000:00080000:2.0:1788850933.686178:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c57800 x1875746019638144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850933.686186:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019638144:0@lo:400: 00010000:00080000:2.0:1788850933.686196:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c56680 x1875746019638656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850933.686203:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788850933.686213:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019638656:0@lo:400: 00010000:00080000:0.0:1788850933.686299:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c57b80 x1875746019637888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850933.686310:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019637888:0@lo:400: 00010000:00080000:0.0:1788850933.686324:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c54380 x1875746019638400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850933.686338:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019638400:0@lo:400: 00000100:00080000:3.0:1788850933.687281:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788850933.687288:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788850933.687291:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788850933.687462:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637760 00000100:00100000:1.0:1788850933.687470:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637760 00000100:00100000:3.0:1788850933.687609:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788850933.687622:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019638784:0@lo:13: 00000100:00100000:3.0:1788850933.687666:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850933.687697:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638784 00000100:00100000:3.0:1788850933.687701:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638784 00000100:00100000:3.0:1788850933.687731:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850933.687738:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019638784:12345-0@lo:13: 00002000:00000024:3.0:1788850933.687754:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850933.687790:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019638784:12345-0@lo:13: Request processed in 53us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850933.687797:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788850933.687827:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c54380 x1875746019638784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850933.687841:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019638784:0@lo:13: 00000100:00100000:1.0:1788850933.688822:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788850933.688837:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:3648:x1875746019637760:12345-0@lo:400: 00000100:00100000:1.0:1788850933.688887:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:3648:x1875746019637760:12345-0@lo:400: Request processed in 55us (3916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850933.688892:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788850933.688986:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019637760:0@lo:400: 00010000:00010000:2.0:1788850933.943439:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850934.711858:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019638912:0@lo:41: 00000100:00100000:2.0:1788850934.711937:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850934.712172:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638912 00000100:00100000:3.0:1788850934.712181:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638912 00000100:00100000:3.0:1788850934.712232:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788850934.712242:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019638912:12345-0@lo:41: 00000004:00000024:3.0:1788850934.712276:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788850934.712325:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019638912:12345-0@lo:41: Request processed in 85us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850934.712331:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788850934.712474:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019638912:0@lo:41: 00010000:00010000:2.0:1788850934.970210:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850935.993161:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850936.756179:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788850936.756216:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019639040:0@lo:41: 00000100:00100000:2.0:1788850936.756288:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850936.756354:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639040 00000100:00100000:2.0:1788850936.756361:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639040 00000100:00100000:2.0:1788850936.756408:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788850936.756418:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019639040:12345-0@lo:41: 00000004:00000024:2.0:1788850936.756450:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788850936.756510:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019639040:12345-0@lo:41: Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850936.756527:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788850936.763158:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019639040:0@lo:41: 00010000:00010000:0.0:1788850937.012450:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850938.040746:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850938.804349:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019639168:0@lo:13: 00000100:00100000:1.0:1788850938.804417:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850938.804590:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639168 00000100:00100000:2.0:1788850938.804599:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639168 00000100:00100000:2.0:1788850938.804654:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788850938.804664:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019639168:12345-0@lo:13: 00002000:00000024:2.0:1788850938.804691:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850938.804739:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019639168:12345-0@lo:13: Request processed in 77us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850938.804746:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788850938.804764:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788850938.806402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019639296:0@lo:400: 00000100:00100000:3.0:1788850938.806459:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850938.806493:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019639808:0@lo:400: 00000100:00100000:3.0:1788850938.806536:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850938.806563:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788850938.806568:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019639424:0@lo:400: 00000100:00100000:3.0:1788850938.806592:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850938.806609:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019639936:0@lo:400: 00000100:00100000:3.0:1788850938.806628:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850938.806657:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639296 00000100:00100000:3.0:1788850938.806662:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639296 00000100:00100000:3.0:1788850938.806698:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788850938.806706:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:3647:x1875746019639296:12345-0@lo:400: 00000100:00100000:3.0:1788850938.806746:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:3647:x1875746019639296:12345-0@lo:400: Request processed in 41us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850938.806752:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788850938.806779:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639808 00000100:00100000:3.0:1788850938.806783:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639808 00000100:00100000:3.0:1788850938.806805:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788850938.806811:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019639808:12345-0@lo:400: 00000100:00100000:3.0:1788850938.806840:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019639808:12345-0@lo:400: Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850938.806845:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788850938.806860:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639424 00000100:00100000:3.0:1788850938.806862:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639424 00000100:00100000:3.0:1788850938.806883:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639936 00000100:00100000:3.0:1788850938.806885:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639936 00000100:00100000:3.0:1788850938.806907:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788850938.806913:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019639424:12345-0@lo:400: 00000100:00100000:3.0:1788850938.806939:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019639424:12345-0@lo:400: Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850938.806950:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788850938.806975:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788850938.806982:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019639936:12345-0@lo:400: 00000100:00100000:3.0:1788850938.807010:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019639936:12345-0@lo:400: Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850938.807040:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788850938.807067:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788850938.807161:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c56680 x1875746019639424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850938.807174:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019639424:0@lo:400: 00010000:00080000:3.0:1788850938.807183:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c55500 x1875746019639936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850938.807189:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019639936:0@lo:400: 00000100:00100000:3.0:1788850938.807196:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019639296:0@lo:400: 00000100:00100000:3.0:1788850938.807203:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019639808:0@lo:400: 00000100:00100000:2.0:1788850938.807750:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019640320:0@lo:13: 00000100:00100000:2.0:1788850938.807789:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850938.807823:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640320 00000100:00100000:2.0:1788850938.807827:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640320 00000100:00100000:2.0:1788850938.807860:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788850938.807867:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019640320:12345-0@lo:13: 00002000:00000024:2.0:1788850938.807883:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850938.807918:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019640320:12345-0@lo:13: Request processed in 52us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850938.807924:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788850938.807940:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788850938.807971:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5ad5880 x1875746019640320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850938.807988:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019640320:0@lo:13: 00000100:00100000:2.0:1788850938.808064:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019639680:0@lo:400: 00000100:00100000:2.0:1788850938.808092:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850938.808110:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019640192:0@lo:400: 00000100:00100000:2.0:1788850938.808131:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788850938.808157:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5ad6d80 x1875746019639168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850938.808170:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019639168:0@lo:13: 00000100:00100000:2.0:1788850938.808182:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788850938.808188:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019639552:0@lo:400: 00000100:00100000:2.0:1788850938.808212:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850938.808229:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019640064:0@lo:400: 00000100:00100000:2.0:1788850938.808246:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850938.808274:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639680 00000100:00100000:2.0:1788850938.808277:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639680 00000100:00100000:2.0:1788850938.808299:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640064 00000100:00100000:2.0:1788850938.808302:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640064 00000100:00100000:2.0:1788850938.808320:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788850938.808325:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019639680:12345-0@lo:400: 00000100:00100000:2.0:1788850938.808355:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019639680:12345-0@lo:400: Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850938.808360:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788850938.808372:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788850938.808377:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019640064:12345-0@lo:400: 00000100:00100000:2.0:1788850938.808401:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019640064:12345-0@lo:400: Request processed in 24us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850938.808407:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788850938.808421:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640192 00000100:00100000:2.0:1788850938.808425:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640192 00000100:00100000:2.0:1788850938.808446:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850938.808452:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019640192:12345-0@lo:400: 00000100:00100000:2.0:1788850938.808478:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019640192:12345-0@lo:400: Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850938.808483:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850938.808498:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639552 00000100:00100000:2.0:1788850938.808502:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639552 00000100:00100000:2.0:1788850938.808522:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788850938.808528:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019639552:12345-0@lo:400: 00000100:00100000:2.0:1788850938.808556:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019639552:12345-0@lo:400: Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850938.808562:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788850938.808593:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788850938.808612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019639552:0@lo:400: 00010000:00080000:2.0:1788850938.808620:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c54700 x1875746019640064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850938.808628:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019640064:0@lo:400: 00010000:00080000:2.0:1788850938.808636:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c55c00 x1875746019639680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850938.808642:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019639680:0@lo:400: 00010000:00080000:2.0:1788850938.808650:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c56300 x1875746019640192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850938.808656:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019640192:0@lo:400: 00010000:00010000:1.0:1788850939.061668:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850939.830111:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019640448:0@lo:41: 00000100:00100000:0.0:1788850939.830183:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.831098:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640448 00000100:00100000:1.0:1788850939.831107:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640448 00000100:00100000:1.0:1788850939.831151:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788850939.831159:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019640448:12345-0@lo:41: 00000004:00000024:1.0:1788850939.831189:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788850939.831712:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019640448:12345-0@lo:41: Request processed in 553us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850939.831721:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788850939.831781:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019640448:0@lo:41: 00010000:00010000:1.0:1788850940.087966:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850941.114490:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850941.876373:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019640576:0@lo:41: 00000100:00100000:1.0:1788850941.876450:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850941.876639:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640576 00000100:00100000:2.0:1788850941.876648:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640576 00000100:00100000:2.0:1788850941.876699:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788850941.876709:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019640576:12345-0@lo:41: 00000004:00000024:2.0:1788850941.876743:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788850941.876798:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019640576:12345-0@lo:41: Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850941.876805:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788850941.876889:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019640576:0@lo:41: 00010000:00010000:1.0:1788850942.132220:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788850942.197199:0:9526:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788850942.197203:0:9526:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788850942.197205:0:9526:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788850942.197340:0:9526:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892ea7c1e800 00000020:01000004:2.0:1788850942.197356:0:9526:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788850942.197370:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788850942.197383:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff892d85c64d40) 00000020:00000080:2.0:1788850942.197399:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788850942.296711:0:9526:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788850942.296772:0:9526:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1788850942.344087:0:9526:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788850942.344311:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788850942.344325:0:9526:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788850942.344337:0:9526:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e0030720b2057b5 00000020:01000004:2.0:1788850942.344344:0:9526:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788850942.344366:0:9526:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788850942.344370:0:9526:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788850942.344376:0:9526:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788850942.344403:0:9526:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788850942.344408:0:9526:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788850942.392627:0:9526:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788850942.392667:0:9526:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788850942.392671:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788850942.392673:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788850942.392674:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850942.392676:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850942.392677:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850942.392678:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850942.392679:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788850942.392680:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850942.392682:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850942.392683:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850942.392684:0:9526:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788850942.392689:0:9526:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788850942.392691:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788850942.392693:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788850942.392694:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850942.392695:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850942.392695:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850942.392696:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850942.392697:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788850942.392698:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850942.392699:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850942.392700:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850942.392706:0:9526:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788850942.392732:0:9526:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788850942.392750:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019640704:0@lo:253: 00000100:00100000:0.0:1788850942.392822:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.394076:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86035000 going to sleep for 11 seconds 00000100:00100000:1.0:1788850942.397196:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640704 00000100:00100000:1.0:1788850942.397210:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640704 00000100:00100000:1.0:1788850942.397306:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788850942.397316:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:9526:x1875746019640704:12345-0@lo:253: 20000000:01000000:1.0:1788850942.397355:0:6528:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788850942.397359:0:6528:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788850942.397364:0:6528:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788850942.397368:0:6528:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788850942.397686:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850942.399225:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788850942.399252:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788850942.399280:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788850942.399286:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788850942.399301:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788850942.399321:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788850942.399433:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788850942.399451:0:6528:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:1.0:1788850942.399452:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1788850942.399467:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788850942.399474:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788850942.399487:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788850942.399493:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1788850942.399505:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788850942.399511:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788850942.399522:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788850942.399536:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788850942.399602:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788850942.399612:0:6528:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:1.0:1788850942.399626:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:1.0:1788850942.399645:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788850942.399651:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788850942.399662:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788850942.399667:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:1.0:1788850942.399676:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788850942.399681:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788850942.399694:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788850942.399709:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788850942.404614:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788850942.404644:0:6528:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.127@tcp 20000000:01000000:0.0:1788850942.404647:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.127@tcp (null) (null) (null) 00000040:00080000:0.0:1788850942.404663:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788850942.404670:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788850942.404685:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788850942.404691:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.127@tcp (null) (null) 00000040:00080000:0.0:1788850942.404704:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788850942.404711:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788850942.404724:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788850942.404738:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788850942.404754:0:6528:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788850942.404756:0:6528:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788850942.404759:0:6528:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788850942.404969:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788850942.404972:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788850942.423193:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788850942.423244:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788850942.423256:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788850942.423489:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788850942.423509:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788850942.423523:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788850942.423532:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788850942.423534:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788850942.425229:0:9533:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788850942.425280:0:9533:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788850942.425294:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788850942.426069:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788850942.426097:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788850942.426113:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1788850942.426124:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788850942.426127:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788850942.426763:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788850942.426795:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788850942.426811:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788850942.430222:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788850942.430256:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788850942.430273:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788850942.430287:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788850942.430306:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788850942.434121:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788850942.434173:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788850942.434188:0:9535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788850942.434440:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788850942.434464:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788850942.434478:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788850942.434488:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788850942.434490:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788850942.434852:0:9536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788850942.435077:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788850942.435097:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788850942.435110:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:3.0:1788850942.435126:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788850942.435148:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435165:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2056ab expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435173:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2056d5 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435179:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205714 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435185:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205730 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435191:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205753 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435198:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205776 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435204:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2057a0 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435218:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435256:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2057a0 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435271:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2057a0 expref: 21 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.435286:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019640832:0@lo:104: 00000100:00100000:3.0:1788850942.435352:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850942.435398:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205776 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435406:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205776 expref: 21 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.435413:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019640960:0@lo:104: 00000100:00100000:3.0:1788850942.435434:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850942.435455:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205753 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435463:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205753 expref: 21 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.435471:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641088:0@lo:104: 00000100:00100000:3.0:1788850942.435489:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850942.435505:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205730 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435519:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205730 expref: 21 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.435526:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641216:0@lo:104: 00000100:00100000:3.0:1788850942.435547:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850942.435574:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205714 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435582:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205714 expref: 21 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.435589:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641344:0@lo:104: 00000100:00100000:3.0:1788850942.435609:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850942.435624:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2056d5 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435632:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2056d5 expref: 21 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.435640:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641472:0@lo:104: 00000100:00100000:3.0:1788850942.435658:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850942.435671:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2056ab expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.435679:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2056ab expref: 21 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.435686:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641600:0@lo:104: 00000100:00100000:3.0:1788850942.435711:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea590ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.435785:0:6518:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788850942.435803:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.435813:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640832 00000100:00100000:0.0:1788850942.435820:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640832 00000100:00100000:0.0:1788850942.435864:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640960 00000100:00100000:0.0:1788850942.435867:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640960 00000100:00100000:0.0:1788850942.435877:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641088 00000100:00100000:0.0:1788850942.435879:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641088 00000100:00100000:0.0:1788850942.435888:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641216 00000100:00100000:0.0:1788850942.435900:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641216 00000100:00100000:0.0:1788850942.435912:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641344 00000100:00100000:0.0:1788850942.435914:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641344 00000100:00100000:0.0:1788850942.435933:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641472 00000100:00100000:0.0:1788850942.435935:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641472 00000100:00100000:0.0:1788850942.435943:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641600 00000100:00100000:0.0:1788850942.435945:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641600 00000100:00100000:0.0:1788850942.435956:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788850942.435964:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6528:x1875746019640832:12345-0@lo:104: 00010000:00010000:0.0:1788850942.435975:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436058:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788850942.436064:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:6528:x1875746019640832:12345-0@lo:104: Request processed in 102us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.436072:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788850942.436089:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788850942.436096:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+8:6528:x1875746019640960:12345-0@lo:104: 00010000:00010000:0.0:1788850942.436104:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436138:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788850942.436143:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+8:6528:x1875746019640960:12345-0@lo:104: Request processed in 49us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.436149:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788850942.436160:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788850942.436166:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+7:6528:x1875746019641088:12345-0@lo:104: 00010000:00010000:0.0:1788850942.436173:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436200:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788850942.436211:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+7:6528:x1875746019641088:12345-0@lo:104: Request processed in 46us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.436218:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788850942.436230:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788850942.436235:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:6528:x1875746019641216:12345-0@lo:104: 00010000:00010000:0.0:1788850942.436242:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436269:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788850942.436273:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:6528:x1875746019641216:12345-0@lo:104: Request processed in 39us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.436278:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788850942.436289:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788850942.436294:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:6528:x1875746019641344:12345-0@lo:104: 00010000:00010000:0.0:1788850942.436301:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436326:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788850942.436330:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:6528:x1875746019641344:12345-0@lo:104: Request processed in 37us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.436335:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788850942.436346:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788850942.436352:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86824c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6528:x1875746019641472:12345-0@lo:104: 00010000:00010000:0.0:1788850942.436359:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436382:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788850942.436393:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86824c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6528:x1875746019641472:12345-0@lo:104: Request processed in 42us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.436399:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788850942.436422:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788850942.436428:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6528:x1875746019641600:12345-0@lo:104: 00010000:00010000:0.0:1788850942.436435:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436460:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788850942.436464:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6528:x1875746019641600:12345-0@lo:104: Request processed in 37us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.436469:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788850942.436486:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788850942.436492:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436497:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebb000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850942.436501:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436508:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850942.436514:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850942.436519:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850942.436555:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436571:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850942.436589:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436595:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b2057a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2057a7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436607:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788850942.436610:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436615:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebbc00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850942.436617:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436623:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850942.436629:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850942.436634:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850942.436647:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436652:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850942.436665:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436671:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e9eebbc00/0x3e0030720b205776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20577d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436687:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788850942.436690:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436695:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95400 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850942.436697:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436703:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850942.436708:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850942.436712:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850942.436726:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436731:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850942.436736:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436742:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b205753 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20575a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436750:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788850942.436753:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436767:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031a00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850942.436770:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436775:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850942.436780:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850942.436785:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850942.436797:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436802:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850942.436808:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436814:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b205730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205737 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436822:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788850942.436824:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436829:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031800 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850942.436832:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436848:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850942.436854:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850942.436859:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850942.436873:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436878:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850942.436882:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436900:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b205714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20571b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436910:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788850942.436913:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436919:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850942.436923:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436929:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850942.436935:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850942.436945:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850942.436958:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436963:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850942.436969:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436975:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff94c00/0x3e0030720b2056d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2056dc expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436983:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850942.436986:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436991:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2155e00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850942.436993:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.436999:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850942.437004:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850942.437009:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850942.437041:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.437047:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850942.437059:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.437065:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ec2155e00/0x3e0030720b2056ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2056b2 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.437078:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850942.437080:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850942.437081:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850942.437089:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850942.437100:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019642112:0@lo:103: 00000100:00100000:0.0:1788850942.437135:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.437159:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788850942.437164:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019641728:0@lo:103: 00000100:00100000:0.0:1788850942.437182:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.437196:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019642240:0@lo:103: 00000100:00100000:0.0:1788850942.437223:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.437247:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019641984:0@lo:103: 00000100:00100000:0.0:1788850942.437270:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.437285:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019642496:0@lo:103: 00000100:00100000:0.0:1788850942.437303:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.437314:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788850942.437318:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019641856:0@lo:103: 00000100:00100000:0.0:1788850942.437335:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.437344:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019642368:0@lo:103: 00000100:00100000:0.0:1788850942.437358:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850942.437616:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642112 00000100:00100000:3.0:1788850942.437622:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642112 00010000:00010000:3.0:1788850942.437647:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205730 expref: 22 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.437663:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641728 00000100:00100000:3.0:1788850942.437665:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641728 00010000:00010000:3.0:1788850942.437677:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2057a0 expref: 23 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.437687:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642240 00000100:00100000:3.0:1788850942.437690:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642240 00010000:00010000:3.0:1788850942.437698:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205714 expref: 24 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.437707:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641984 00000100:00100000:3.0:1788850942.437709:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641984 00010000:00010000:3.0:1788850942.437718:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205753 expref: 25 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.437727:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642496 00000100:00100000:3.0:1788850942.437729:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642496 00010000:00010000:3.0:1788850942.437738:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2056ab expref: 26 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.437747:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641856 00000100:00100000:3.0:1788850942.437749:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641856 00010000:00010000:3.0:1788850942.437758:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205776 expref: 27 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.437766:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642368 00000100:00100000:3.0:1788850942.437768:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642368 00010000:00010000:3.0:1788850942.437786:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2056d5 expref: 28 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.437800:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788850942.437807:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+28:3649:x1875746019642112:12345-0@lo:103: 00010000:00010000:3.0:1788850942.437818:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850942.437835:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205730 expref: 28 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.437844:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205730 expref: 28 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.437859:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850942.437909:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+28:3649:x1875746019642112:12345-0@lo:103: Request processed in 103us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.437915:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788850942.437930:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788850942.437936:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+27:3649:x1875746019641728:12345-0@lo:103: 00010000:00010000:3.0:1788850942.437943:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850942.437947:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2057a0 expref: 27 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.437956:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2057a0 expref: 27 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.437965:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850942.437996:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+27:3649:x1875746019641728:12345-0@lo:103: Request processed in 49us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.438001:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788850942.438044:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788850942.438050:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+26:3649:x1875746019642240:12345-0@lo:103: 00010000:00010000:3.0:1788850942.438057:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850942.438062:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205714 expref: 26 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438070:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205714 expref: 26 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438078:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850942.438100:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+26:3649:x1875746019642240:12345-0@lo:103: Request processed in 51us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.438105:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788850942.438118:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788850942.438123:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3648:x1875746019641984:12345-0@lo:103: 00010000:00010000:3.0:1788850942.438129:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850942.438133:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205753 expref: 25 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438140:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205753 expref: 25 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438148:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850942.438174:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3648:x1875746019641984:12345-0@lo:103: Request processed in 52us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.438180:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788850942.438211:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788850942.438217:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019642496:12345-0@lo:103: 00010000:00010000:3.0:1788850942.438224:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850942.438232:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2056ab expref: 24 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438239:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2056ab expref: 24 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438248:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850942.438271:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019642496:12345-0@lo:103: Request processed in 55us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.438276:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788850942.438288:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788850942.438294:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3648:x1875746019641856:12345-0@lo:103: 00010000:00010000:3.0:1788850942.438300:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850942.438304:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205776 expref: 23 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438312:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205776 expref: 23 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438320:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850942.438340:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3648:x1875746019641856:12345-0@lo:103: Request processed in 48us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.438345:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788850942.438356:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788850942.438362:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:3648:x1875746019642368:12345-0@lo:103: 00010000:00010000:3.0:1788850942.438367:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850942.438371:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2056d5 expref: 22 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438390:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2056d5 expref: 22 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438402:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438410:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438425:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438432:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438438:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438445:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438451:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2154e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788850942.438456:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438463:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438472:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438493:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850942.438516:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:3648:x1875746019642368:12345-0@lo:103: Request processed in 155us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.438522:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788850942.438556:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019641856:0@lo:103: 00000100:00100000:3.0:1788850942.438566:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019642368:0@lo:103: 00000100:00100000:3.0:1788850942.438573:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019641984:0@lo:103: 00000100:00100000:3.0:1788850942.438579:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019642496:0@lo:103: 00010000:00010000:3.0:1788850942.438615:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827ea000/0x3e0030720b2057a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2057a0 expref: 21 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.438627:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019640832:0@lo:104: 00010000:00010000:3.0:1788850942.438637:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebb200/0x3e0030720b20577d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205776 expref: 20 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.438645:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019640960:0@lo:104: 00010000:00010000:3.0:1788850942.438655:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80030800/0x3e0030720b20575a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205753 expref: 19 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.438662:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641088:0@lo:104: 00010000:00010000:3.0:1788850942.438671:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94a00/0x3e0030720b205737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205730 expref: 18 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.438679:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641216:0@lo:104: 00010000:00010000:3.0:1788850942.438687:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebbe00/0x3e0030720b20571b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205714 expref: 17 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.438702:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641344:0@lo:104: 00010000:00010000:3.0:1788850942.438714:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eeba200/0x3e0030720b2056dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2056d5 expref: 16 pid: 6528 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.438722:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641472:0@lo:104: 00010000:00010000:3.0:1788850942.438731:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94e00/0x3e0030720b2056b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2056ab expref: 15 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.438738:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875746019641600:0@lo:104: 00010000:00010000:3.0:1788850942.438761:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438769:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438774:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.438780:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788850942.438794:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788850942.442747:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019641728:0@lo:103: 00000100:00100000:0.0:1788850942.442781:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019642240:0@lo:103: 00000100:00100000:0.0:1788850942.442789:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019642112:0@lo:103: 00000100:00100000:0.0:1788850942.452578:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:9526:x1875746019640704:12345-0@lo:253: Request processed in 55254us (59747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.452594:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788850942.455409:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019640704:0@lo:253: 10000000:01000000:2.0:1788850942.455430:0:9526:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788850942.455434:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788850942.455435:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788850942.455437:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788850942.455438:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788850942.455440:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788850942.455441:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788850942.455442:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788850942.455444:0:9526:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788850942.455445:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788850942.455447:0:9526:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788850942.455474:0:9526:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892ea7c1e800 from lustre-OST0001 10000000:01000000:2.0:1788850942.455512:0:9526:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788850942.455515:0:9526:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788850942.455524:0:9526:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff892ebbbc99c0 local copy 10000000:01000000:2.0:1788850942.455528:0:9526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788850942.455573:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.455583:0:9526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.455614:0:9526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850942.455636:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019642624:0@lo:101: 00000100:00100000:2.0:1788850942.455702:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.455789:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64840 going to sleep for 11 seconds 00000100:00100000:3.0:1788850942.457163:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642624 00000100:00100000:3.0:1788850942.457175:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642624 00000100:00100000:3.0:1788850942.457231:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788850942.457242:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+14:9526:x1875746019642624:12345-0@lo:101: 00010000:00010000:3.0:1788850942.457257:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850942.457277:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2057c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.457319:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2057c3 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.457331:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2057c3 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.457340:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2154e00, rc 0) 00000100:00100000:3.0:1788850942.457403:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019642624:12345-0@lo:101: Request processed in 164us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.457410:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788850942.457573:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019642624:0@lo:101: 00010000:00010000:2.0:1788850942.457588:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.457598:0:9526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850942.457719:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019642752:0@lo:501: 00000100:00100000:2.0:1788850942.457751:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.457782:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64840 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.457852:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642752 00000100:00100000:0.0:1788850942.457856:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642752 00000100:00100000:0.0:1788850942.457898:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788850942.457906:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019642752:12345-0@lo:501: 00000100:00100000:0.0:1788850942.457972:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019642752:12345-0@lo:501: Request processed in 67us (220us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788850942.457979:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788850942.458190:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019642752:0@lo:501: 10000000:01000000:2.0:1788850942.458203:0:9526:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788850942.458220:0:9526:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788850942.458226:0:9526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.458235:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.458242:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.458274:0:9526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788850942.458307:0:9526:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892ea7c1e800 10000000:01000000:2.0:1788850942.458312:0:9526:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788850942.458317:0:9526:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788850942.458320:0:9526:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788850942.458325:0:9526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788850942.458328:0:9526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788850942.458348:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.458356:0:9526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.458364:0:9526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850942.458376:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019642880:0@lo:101: 00000100:00100000:2.0:1788850942.458404:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.458424:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64000 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.458480:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642880 00000100:00100000:0.0:1788850942.458484:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642880 00000100:00100000:0.0:1788850942.458517:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788850942.458524:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019642880:12345-0@lo:101: 00010000:00010000:0.0:1788850942.458531:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850942.458540:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2057d1 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.458556:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2057d1 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.458564:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2057d1 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.458571:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433ca00, rc 0) 00000100:00100000:0.0:1788850942.458607:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019642880:12345-0@lo:101: Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.458613:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:0.0:1788850942.458636:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850942.458642:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.458650:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850942.458654:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.458661:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850942.458668:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850942.458674:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850942.458691:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.458697:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850942.458716:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.458722:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2057c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3e0030720b2057ca expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.458733:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850942.458735:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850942.458736:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850942.458750:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788850942.458760:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019643008:0@lo:103: 00000100:00100000:0.0:1788850942.458786:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.458819:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643008 00000100:00100000:0.0:1788850942.458835:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643008 00000100:00100000:0.0:1788850942.458866:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850942.458873:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:3650:x1875746019643008:12345-0@lo:103: 00010000:00010000:0.0:1788850942.458882:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850942.458903:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2154e00/0x3e0030720b2057ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b2057c3 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.458914:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850942.458942:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:3650:x1875746019643008:12345-0@lo:103: Request processed in 70us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.458948:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850942.458975:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019643008:0@lo:103: 00000100:00100000:2.0:1788850942.459410:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019642880:0@lo:101: 00010000:00010000:2.0:1788850942.459422:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.459431:0:9526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850942.459500:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643136:0@lo:501: 00000100:00100000:2.0:1788850942.459537:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.459567:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64000 going to sleep for 11 seconds 00000100:00100000:2.0:1788850942.459580:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643136 00000100:00100000:2.0:1788850942.459584:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643136 00000100:00100000:2.0:1788850942.459605:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788850942.459610:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019643136:12345-0@lo:501: 00000100:00100000:2.0:1788850942.459708:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019643136:12345-0@lo:501: Request processed in 98us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.459715:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788850942.459741:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643136:0@lo:501: 00000100:00100000:2.0:1788850942.459763:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643264:0@lo:503: 00000100:00100000:2.0:1788850942.459799:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.459807:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64000 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.459917:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643264 00000100:00100000:0.0:1788850942.459922:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643264 00000100:00100000:0.0:1788850942.459941:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788850942.459948:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019643264:12345-0@lo:503: 00000100:00100000:0.0:1788850942.460059:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019643264:12345-0@lo:503: Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.460066:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788850942.460206:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643264:0@lo:503: 00000040:00080000:2.0:1788850942.460707:0:9526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788850942.460783:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643392:0@lo:502: 00000100:00100000:2.0:1788850942.463099:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.463154:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64240 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.463312:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643392 00000100:00100000:0.0:1788850942.463321:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643392 00000100:00100000:0.0:1788850942.463367:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788850942.463375:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019643392:12345-0@lo:502: 00000100:00100000:0.0:1788850942.463513:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019643392:12345-0@lo:502: Request processed in 138us (2689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.463526:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788850942.463763:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643392:0@lo:502: 00000040:00080000:2.0:1788850942.467954:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788850942.468035:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788850942.468049:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788850942.468060:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788850942.468072:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788850942.468096:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788850942.468141:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643520:0@lo:502: 00000100:00100000:2.0:1788850942.468234:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.468270:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64240 going to sleep for 11 seconds 00000100:00100000:3.0:1788850942.468866:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643520 00000100:00100000:3.0:1788850942.468876:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643520 00000100:00100000:3.0:1788850942.468938:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788850942.468946:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019643520:12345-0@lo:502: 00000100:00100000:3.0:1788850942.469094:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019643520:12345-0@lo:502: Request processed in 148us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.469101:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788850942.469238:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643520:0@lo:502: 00000040:00080000:1.0:1788850942.469304:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788850942.469315:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1788850942.469949:0:9537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788850942.469958:0:9537:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788850942.469971:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850942.469974:0:9537:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788850942.469980:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788850942.470050:0:9537:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff892d874a3380) 00000020:00000080:1.0:1788850942.470074:0:9537:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788850942.470081:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788850942.470149:0:9537:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892ea7c1e800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788850942.470159:0:9537:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788850942.470167:0:9537:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e0030720b2057e6 00010000:00010000:0.0:1788850942.478369:0:9537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1788850942.478669:0:9537:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788850942.485443:0:9537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788850942.485791:0:9537:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788850942.495834:0:9537:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788850942.496145:0:9537:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788850942.502692:0:9537:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788850942.506690:0:9537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788850942.506703:0:9537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850942.506710:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850942.506712:0:9537:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788850942.506716:0:9537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850942.506720:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850942.506722:0:9537:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788850942.506725:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788850942.506727:0:9537:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788850942.506755:0:9537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850942.506760:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850942.506761:0:9537:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788850942.506764:0:9537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788850942.509135:0:9526:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788850942.509188:0:9526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788850942.509224:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850942.509237:0:9526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850942.509247:0:9526:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea7c1e800 from 1 10000000:01000000:1.0:1788850942.509249:0:9526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788850942.509290:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850942.509299:0:9526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850942.509310:0:9526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850942.509334:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643648:0@lo:101: 00000100:00100000:1.0:1788850942.509417:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850942.509461:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e852cef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.510100:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643648 00000100:00100000:0.0:1788850942.510111:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643648 00000100:00100000:0.0:1788850942.510167:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788850942.510178:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:9526:x1875746019643648:12345-0@lo:101: 00010000:00010000:0.0:1788850942.510193:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850942.510209:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2057ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.510246:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2057ed expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.510265:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2057ed expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.510274:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d400, rc 0) 00000100:00100000:0.0:1788850942.510328:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019643648:12345-0@lo:101: Request processed in 151us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.510335:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788850942.510386:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643648:0@lo:101: 00010000:00010000:0.0:1788850942.510401:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.510410:0:9526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850942.510504:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643776:0@lo:501: 00000100:00100000:0.0:1788850942.510530:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.510550:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.510563:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643776 00000100:00100000:0.0:1788850942.510566:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643776 00000100:00100000:0.0:1788850942.510586:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788850942.510591:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019643776:12345-0@lo:501: 00000100:00100000:0.0:1788850942.510676:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019643776:12345-0@lo:501: Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.510683:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788850942.510714:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643776:0@lo:501: 00000100:00100000:0.0:1788850942.510737:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643904:0@lo:503: 00000100:00100000:0.0:1788850942.510780:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.510792:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.510805:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643904 00000100:00100000:0.0:1788850942.510809:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643904 00000100:00100000:0.0:1788850942.512362:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788850942.512379:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019643904:12345-0@lo:503: 00000100:00100000:0.0:1788850942.512509:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019643904:12345-0@lo:503: Request processed in 136us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.512516:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788850942.512568:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019643904:0@lo:503: 00000040:00080000:0.0:1788850942.512809:0:9526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788850942.523525:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644032:0@lo:502: 00000100:00100000:1.0:1788850942.523612:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850942.523787:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e852ceb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850942.527973:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644032 00000100:00100000:3.0:1788850942.527997:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644032 00000100:00100000:3.0:1788850942.529843:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788850942.529858:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019644032:12345-0@lo:502: 00000100:00100000:3.0:1788850942.530070:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019644032:12345-0@lo:502: Request processed in 216us (6457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.530079:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788850942.530202:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644032:0@lo:502: 00000040:00080000:1.0:1788850942.532564:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788850942.532603:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788850942.532645:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644160:0@lo:502: 00000100:00100000:1.0:1788850942.532715:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850942.535441:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e852ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.535546:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644160 00000100:00100000:0.0:1788850942.535556:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644160 00000100:00100000:0.0:1788850942.535610:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788850942.535619:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019644160:12345-0@lo:502: 00000100:00100000:0.0:1788850942.535786:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019644160:12345-0@lo:502: Request processed in 168us (3070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.535794:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788850942.536175:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644160:0@lo:502: 00000040:00080000:1.0:1788850942.536482:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788850942.536496:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788850942.537190:0:9541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850942.537200:0:9541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850942.537202:0:9541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788850942.537209:0:9541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892ea7c1e800 00000020:00000080:1.0:1788850942.537223:0:9541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788850942.537235:0:9541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850942.537238:0:9541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850942.537239:0:9541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788850942.537242:0:9541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788850942.537478:0:9526:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788850942.537502:0:9526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788850942.537522:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.537533:0:9526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850942.537584:0:9526:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788850942.537587:0:9526:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892ea7c1e800 10000000:01000000:0.0:1788850942.537598:0:9526:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892ea7c1e800 10000000:01000000:0.0:1788850942.537602:0:9526:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788850942.537608:0:9526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ea7c1e800 from 1 10000000:01000000:0.0:1788850942.537611:0:9526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788850942.537649:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.537657:0:9526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.537668:0:9526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850942.537689:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644288:0@lo:101: 00000100:00100000:0.0:1788850942.537745:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.537785:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443300 going to sleep for 11 seconds 00000100:00100000:1.0:1788850942.537935:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644288 00000100:00100000:1.0:1788850942.537942:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644288 00000100:00100000:1.0:1788850942.537995:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788850942.538004:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9526:x1875746019644288:12345-0@lo:101: 00010000:00010000:1.0:1788850942.538042:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850942.538055:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2057fb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850942.538088:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2057fb expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850942.538097:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2057fb expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850942.538105:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94600, rc 0) 00000100:00100000:1.0:1788850942.538144:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019644288:12345-0@lo:101: Request processed in 141us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850942.538151:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788850942.538404:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644288:0@lo:101: 00010000:00010000:0.0:1788850942.538418:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.538427:0:9526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850942.538514:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644416:0@lo:501: 00000100:00100000:0.0:1788850942.538541:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.538570:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443300 going to sleep for 11 seconds 00000100:00100000:1.0:1788850942.538611:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644416 00000100:00100000:1.0:1788850942.538615:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644416 00000100:00100000:1.0:1788850942.538645:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788850942.538652:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019644416:12345-0@lo:501: 00000100:00100000:1.0:1788850942.538751:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019644416:12345-0@lo:501: Request processed in 99us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850942.538757:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788850942.538817:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644416:0@lo:501: 00000100:00100000:0.0:1788850942.538854:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644544:0@lo:503: 00000100:00100000:0.0:1788850942.538909:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.538927:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443300 going to sleep for 11 seconds 00000100:00100000:1.0:1788850942.539087:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644544 00000100:00100000:1.0:1788850942.539091:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644544 00000100:00100000:1.0:1788850942.539107:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788850942.539113:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019644544:12345-0@lo:503: 00000100:00100000:1.0:1788850942.539184:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019644544:12345-0@lo:503: Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850942.539190:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788850942.539496:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644544:0@lo:503: 00000040:00080000:0.0:1788850942.539705:0:9526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788850942.539770:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644672:0@lo:502: 00000100:00100000:0.0:1788850942.539805:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.539843:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86127c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788850942.539951:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644672 00000100:00100000:1.0:1788850942.539956:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644672 00000100:00100000:3.0:1788850942.540085:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788850942.540097:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019644672:12345-0@lo:502: 00000100:00100000:3.0:1788850942.540193:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019644672:12345-0@lo:502: Request processed in 100us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.540200:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788850942.540601:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644672:0@lo:502: 00000040:00080000:0.0:1788850942.540789:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788850942.540817:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788850942.540920:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788850942.540933:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788850942.540946:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788850942.540957:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788850942.541122:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788850942.541146:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788850942.541161:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788850942.541174:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788850942.541188:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788850942.541201:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788850942.541214:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788850942.541226:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788850942.541239:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788850942.541251:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788850942.541265:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788850942.541277:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788850942.541288:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788850942.541301:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788850942.541314:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788850942.541329:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788850942.541362:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788850942.541379:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788850942.541391:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788850942.541403:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788850942.541415:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788850942.541427:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788850942.541440:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788850942.541451:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788850942.541463:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788850942.541474:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788850942.541486:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788850942.541498:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788850942.541509:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788850942.541523:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788850942.541536:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788850942.541549:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788850942.541576:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788850942.541592:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788850942.541606:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788850942.541619:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788850942.541632:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788850942.541645:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788850942.541659:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788850942.541671:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788850942.541703:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644800:0@lo:502: 00000100:00100000:0.0:1788850942.541763:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.541811:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443300 going to sleep for 11 seconds 00000100:00100000:1.0:1788850942.541936:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644800 00000100:00100000:1.0:1788850942.541948:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644800 00000100:00100000:1.0:1788850942.541980:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788850942.542002:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019644800:12345-0@lo:502: 00000100:00100000:1.0:1788850942.542112:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019644800:12345-0@lo:502: Request processed in 112us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850942.542119:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788850942.542434:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019644800:0@lo:502: 00000040:00080000:0.0:1788850942.542483:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788850942.542492:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788850942.543641:0:9542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788850942.543658:0:9542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff892d85c60000) 00000020:00000080:2.0:1788850942.543683:0:9542:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788850942.543781:0:9542:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892ea7c1e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788850942.543785:0:9542:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ea7c1e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788850942.543788:0:9542:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea7c1e800 3 00010000:00080000:2.0:1788850942.543885:0:9542:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d87492800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1788850942.548202:0:9542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788850942.548488:0:9542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788850942.548535:0:9542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788850942.548549:0:9542:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3e0030720b205810 00000100:00080000:2.0:1788850942.548560:0:9542:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788850942.548572:0:9542:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892d87492800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788850942.548610:0:9542:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad4000 x1875746019644928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788850942.548670:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019644928:0@lo:38: 00000100:00100000:0.0:1788850942.548744:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850942.548843:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644928 00000100:00100000:1.0:1788850942.548852:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644928 00000100:00100000:1.0:1788850942.548904:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788850942.548911:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019644928:12345-0@lo:38: 00010000:00080000:1.0:1788850942.548933:0:6534:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:1.0:1788850942.548962:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e0030720b205817 00000004:00100000:1.0:1788850942.548975:0:6534:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788850942.549032:0:6534:0:(import.c:65:import_set_state_nolock()) ffff892d876be000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788850942.549113:0:9542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788850942.549210:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019645440:0@lo:400: 00000100:00100000:2.0:1788850942.549241:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.549260:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019645952:0@lo:400: 00000100:00100000:2.0:1788850942.549280:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.549299:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788850942.549305:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019645056:0@lo:400: 00000100:00100000:2.0:1788850942.549326:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.549341:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019645568:0@lo:400: 00000100:00100000:2.0:1788850942.549358:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.549392:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645440 00000100:00100000:2.0:1788850942.549396:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645440 00000100:00100000:2.0:1788850942.549427:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788850942.549432:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019645440:12345-0@lo:400: 00000100:00100000:2.0:1788850942.549471:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019645440:12345-0@lo:400: Request processed in 38us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.549478:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788850942.549497:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645952 00000100:00100000:2.0:1788850942.549500:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645952 00000100:00100000:2.0:1788850942.549528:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788850942.549534:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019645952:12345-0@lo:400: 00000100:00100000:2.0:1788850942.549562:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019645952:12345-0@lo:400: Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.549568:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788850942.549585:0:6535:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788850942.549591:0:6535:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788850942.549605:0:6536:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788850942.549609:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645056 00000100:00100000:2.0:1788850942.549612:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645056 00000100:00100000:2.0:1788850942.549629:0:6536:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788850942.549632:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645568 00000100:00100000:2.0:1788850942.549635:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645568 00000100:00100000:2.0:1788850942.549647:0:6536:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788850942.549652:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788850942.549659:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019645056:12345-0@lo:400: 00000100:00100000:2.0:1788850942.549688:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019645056:12345-0@lo:400: Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.549693:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788850942.549704:0:6536:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788850942.549709:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788850942.549720:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019645568:12345-0@lo:400: 00000100:00100000:2.0:1788850942.549745:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019645568:12345-0@lo:400: Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.549751:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788850942.549768:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788850942.549772:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788850942.549797:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5ad6a00 x1875746019645056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850942.549810:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019645056:0@lo:400: 00010000:00080000:2.0:1788850942.549820:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5990380 x1875746019645568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850942.549828:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019645568:0@lo:400: 00000100:00100000:2.0:1788850942.549837:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019645440:0@lo:400: 00010000:00080000:2.0:1788850942.549844:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5991c00 x1875746019645952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850942.549852:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019645952:0@lo:400: 00000020:01000004:2.0:1788850942.550100:0:9542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788850942.550113:0:9542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff892d85c619c0) 00000020:00000080:2.0:1788850942.550130:0:9542:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788850942.550194:0:9542:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892ea7c1e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788850942.550198:0:9542:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ea7c1e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788850942.550200:0:9542:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea7c1e800 3 00010000:00080000:2.0:1788850942.550223:0:9542:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d87497800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.127@tcp at head 00000100:00100000:3.0:1788850942.553434:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019645184:0@lo:400: 00000100:00100000:3.0:1788850942.553507:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850942.553547:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019645696:0@lo:400: 00000100:00100000:3.0:1788850942.553572:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850942.553600:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788850942.553606:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019645312:0@lo:400: 00000100:00100000:3.0:1788850942.553626:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850942.553638:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019645824:0@lo:400: 00000100:00100000:3.0:1788850942.553659:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850942.553695:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645184 00000100:00100000:3.0:1788850942.553702:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645184 00000100:00100000:3.0:1788850942.553746:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788850942.553755:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019645184:12345-0@lo:400: 00000100:00100000:3.0:1788850942.553810:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019645184:12345-0@lo:400: Request processed in 55us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.553817:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788850942.553841:0:6536:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788850942.553848:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645696 00000100:00100000:3.0:1788850942.553851:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645696 00000100:00100000:3.0:1788850942.553878:0:6536:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788850942.553883:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645312 00000100:00100000:3.0:1788850942.553886:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645312 00000100:00100000:3.0:1788850942.553915:0:6536:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788850942.553921:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788850942.553927:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019645696:12345-0@lo:400: 00000100:00100000:3.0:1788850942.553966:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019645696:12345-0@lo:400: Request processed in 39us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.553972:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788850942.553983:0:6536:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788850942.553988:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788850942.553994:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019645312:12345-0@lo:400: 00000100:00100000:3.0:1788850942.554039:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019645312:12345-0@lo:400: Request processed in 46us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.554045:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788850942.554064:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645824 00000100:00100000:3.0:1788850942.554067:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645824 00000100:00100000:3.0:1788850942.554094:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850942.554100:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019645824:12345-0@lo:400: 00000100:00100000:3.0:1788850942.554129:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019645824:12345-0@lo:400: Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.554134:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788850942.554154:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788850942.554158:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788850942.554186:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5990000 x1875746019645312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850942.554200:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019645312:0@lo:400: 00010000:00080000:3.0:1788850942.554211:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5990a80 x1875746019645824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850942.554218:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019645824:0@lo:400: 00000100:00100000:3.0:1788850942.554227:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019645184:0@lo:400: 00010000:00080000:3.0:1788850942.554245:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5993100 x1875746019645696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850942.554252:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019645696:0@lo:400: 00010000:00010000:2.0:1788850942.555266:0:9542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788850942.555495:0:9542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788850942.555538:0:9542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788850942.555555:0:9542:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x3e0030720b205825 00000100:00080000:2.0:1788850942.555564:0:9542:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788850942.555573:0:9542:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff892d87497800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788850942.555606:0:9542:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5991c00 x1875746019646080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788850942.555620:0:9542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788850942.556080:0:9544:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff892ea5991880 x1875746019646208/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850942.556091:0:9544:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64600 going to sleep for 0 seconds 00000040:00080000:2.0:1788850942.556189:0:9542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:1.0:1788850942.559332:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875746019644928:12345-0@lo:38: Request processed in 10411us (10580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850942.559347:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788850942.560281:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5ad4000 x1875746019644928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788850952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850942.560294:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788850942.560304:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788850942.560313:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788850942.560318:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788850942.560321:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788850942.560329:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000004b6fda4): req@ffff892ea5991880 x1875746019646208/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850942.560356:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019644928:0@lo:38: 00000020:01000000:0.0:1788850942.560398:0:9526:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788850942.560437:0:9526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788850942.560453:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.560463:0:9526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788850942.560516:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788850942.560518:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788850942.560520:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850942.560521:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850942.560522:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850942.560524:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850942.560525:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788850942.560526:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850942.560528:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850942.560529:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850942.560531:0:9526:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788850942.560540:0:9526:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788850942.560542:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788850942.560543:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788850942.560544:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850942.560545:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850942.560545:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850942.560546:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850942.560547:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788850942.560548:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850942.560549:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850942.560550:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850942.560550:0:9526:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788850942.560573:0:9526:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788850942.560588:0:9526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019646336:0@lo:253: 00000100:00100000:0.0:1788850942.560651:0:9526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.560684:0:9526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86127c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850942.560704:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646336 00000100:00100000:0.0:1788850942.560711:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646336 00000100:00100000:0.0:1788850942.560750:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788850942.560759:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019646336:12345-0@lo:253: 20000000:01000000:0.0:1788850942.560783:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788850942.560798:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788850942.560971:0:9544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850942.561010:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646208 00000100:00100000:1.0:1788850942.561033:0:6545:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646208 00000100:00100000:1.0:1788850942.561072:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788850942.561079:0:6545:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9544:x1875746019646208:12345-0@lo:901: 00000100:00100000:1.0:1788850942.561159:0:6545:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9544:x1875746019646208:12345-0@lo:901: Request processed in 81us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850942.561167:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788850942.561195:0:9544:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5991880 x1875746019646208/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788850958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850942.561219:0:9544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9544:1875746019646208:0@lo:901: 00000100:00080000:3.0:1788850942.564134:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850942.565159:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019646080:0@lo:38: 00000100:00100000:0.0:1788850942.565232:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850942.565380:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646080 00000100:00100000:3.0:1788850942.565389:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646080 00000100:00100000:3.0:1788850942.565425:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850942.565431:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019646080:12345-0@lo:38: 00010000:00080000:3.0:1788850942.565460:0:6536:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1788850942.565496:0:6536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x3e0030720b20582c 00000004:00100000:3.0:1788850942.565513:0:6536:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788850942.565544:0:6536:0:(import.c:65:import_set_state_nolock()) ffff892ea5b9d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850942.565598:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875746019646080:12345-0@lo:38: Request processed in 165us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.565605:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788850942.565664:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5991c00 x1875746019646080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788850952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850942.565675:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788850942.565682:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788850942.565689:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788850942.565694:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788850942.565696:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d87497800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788850942.565701:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019646080:0@lo:38: 20000000:01000000:0.0:1788850942.574390:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788850942.574416:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788850942.574690:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9526:x1875746019646336:12345-0@lo:253: Request processed in 13928us (14034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850942.574703:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788850942.574769:0:9526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c5226fe-29cd-49fb-9546-e50c12b232cb:9526:1875746019646336:0@lo:253: 10000000:01000000:0.0:1788850942.574785:0:9526:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788850942.574788:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788850942.574799:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788850942.574801:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850942.574802:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850942.574804:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850942.574805:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850942.574806:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788850942.574808:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850942.574809:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850942.574810:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850942.574812:0:9526:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788850942.574838:0:9526:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788850942.577219:0:6550:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788850942.577230:0:6550:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788850942.577254:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.577271:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205722 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.577279:0:6550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205768 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.577286:0:6550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.577327:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205768 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.577371:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205768 expref: 16 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850942.577385:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019646464:0@lo:104: 00000100:00100000:2.0:1788850942.577471:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850942.577527:0:6550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205722 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.577535:0:6550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205722 expref: 16 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850942.577543:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019646592:0@lo:104: 00000100:00100000:2.0:1788850942.577559:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.577574:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850942.577598:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646464 00000100:00100000:2.0:1788850942.577604:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646464 00000100:00100000:2.0:1788850942.577633:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646592 00000100:00100000:2.0:1788850942.577634:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646592 00000100:00100000:2.0:1788850942.577644:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850942.577651:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6550:x1875746019646464:12345-0@lo:104: 00010000:00010000:2.0:1788850942.577661:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.577710:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788850942.577716:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:6550:x1875746019646464:12345-0@lo:104: Request processed in 65us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.577722:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850942.577738:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788850942.577743:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6550:x1875746019646592:12345-0@lo:104: 00010000:00010000:2.0:1788850942.577750:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.577780:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788850942.577791:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:6550:x1875746019646592:12345-0@lo:104: Request processed in 48us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.577796:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788850942.577847:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788850942.577853:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578098:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788850942.578102:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578111:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850942.578118:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850942.578123:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850942.578149:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578154:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850942.578170:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578177:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b205768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20576f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578186:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788850942.578189:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578203:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788850942.578206:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578212:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850942.578217:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850942.578222:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850942.578232:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578237:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850942.578245:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578251:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b205722 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205729 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578264:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850942.578265:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850942.578267:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850942.578282:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019646720:0@lo:103: 00000100:00100000:2.0:1788850942.578314:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.578351:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646720 00000100:00100000:2.0:1788850942.578355:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646720 00010000:00010000:2.0:1788850942.578372:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205768 expref: 17 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850942.578400:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850942.578407:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3650:x1875746019646720:12345-0@lo:103: 00010000:00010000:2.0:1788850942.578417:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850942.578423:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205768 expref: 17 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578432:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205768 expref: 17 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.578445:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850942.578472:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3650:x1875746019646720:12345-0@lo:103: Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.578478:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850942.578514:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019646720:0@lo:103: 00000100:00100000:3.0:1788850942.578567:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019646848:0@lo:103: 00000100:00100000:3.0:1788850942.578594:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850942.578626:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646848 00000100:00100000:3.0:1788850942.578629:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646848 00010000:00010000:3.0:1788850942.578647:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205722 expref: 17 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850942.578664:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788850942.578669:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3647:x1875746019646848:12345-0@lo:103: 00010000:00010000:3.0:1788850942.578676:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850942.578680:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205722 expref: 17 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.578688:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205722 expref: 17 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.578700:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.578708:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788850942.578721:0:6520:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010869659s 00010000:00010000:3.0:1788850942.579010:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.579035:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.579042:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.579048:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.579063:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ebe00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788850942.579067:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.579075:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.579083:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850942.579092:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850942.579123:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:3647:x1875746019646848:12345-0@lo:103: Request processed in 453us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.579129:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788850942.579159:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019646848:0@lo:103: 00010000:00010000:2.0:1788850942.579215:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031400/0x3e0030720b20576f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205768 expref: 16 pid: 6529 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850942.579225:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019646464:0@lo:104: 00010000:00010000:2.0:1788850942.579237:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94400/0x3e0030720b205729 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205722 expref: 15 pid: 6526 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850942.579244:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6550:1875746019646592:0@lo:104: 00010000:00010000:2.0:1788850942.579456:0:6550:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.579465:0:6550:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.579481:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850942.579486:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827ebe00/0x3e0030720b205833 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850942.581968:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788850942.583432:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788850942.583598:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788850942.583817:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788850942.584316:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788850942.585526:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788850942.585806:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788850942.586922:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788850942.600308:0:9526:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788850942.600319:0:9526:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788850942.600356:0:9526:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788850942.600395:0:9526:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788850942.600417:0:9526:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788850942.600435:0:9526:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788850942.601271:0:9526:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788850942.601462:0:9526:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788850943.161933:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788850943.367749:0:9599:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788850943.367988:0:9599:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788850943.926481:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788850943.926509:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019646976:0@lo:13: 00000100:00100000:3.0:1788850943.926574:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850943.926840:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019647104:0@lo:13: 00000100:00100000:1.0:1788850943.926881:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850943.926922:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646976 00000100:00100000:1.0:1788850943.926929:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646976 00000100:00100000:1.0:1788850943.926960:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647104 00000100:00100000:1.0:1788850943.926962:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647104 00000100:00100000:1.0:1788850943.926975:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788850943.926983:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019646976:12345-0@lo:13: 00002000:00000024:1.0:1788850943.927025:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850943.927079:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019646976:12345-0@lo:13: Request processed in 96us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850943.927085:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788850943.927102:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788850943.927107:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019647104:12345-0@lo:13: 00002000:00000024:1.0:1788850943.927116:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850943.927140:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019647104:12345-0@lo:13: Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850943.927226:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788850943.927272:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1b800 x1875746019647104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850943.927291:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019647104:0@lo:13: 00010000:00080000:0.0:1788850943.929072:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ce00 x1875746019646976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850943.929096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019646976:0@lo:13: 00010000:00010000:0.0:1788850944.181244:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850944.948911:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850944.948941:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019647232:0@lo:41: 00000100:00100000:2.0:1788850944.949053:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850944.949167:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647232 00000100:00100000:3.0:1788850944.949175:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647232 00000100:00100000:3.0:1788850944.949233:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788850944.949243:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019647232:12345-0@lo:41: 00000004:00000024:3.0:1788850944.949276:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788850944.949333:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019647232:12345-0@lo:41: Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850944.949340:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788850944.949484:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019647232:0@lo:41: 00010000:00010000:3.0:1788850945.206066:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850946.228158:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850946.996271:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788850946.996296:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019647360:0@lo:41: 00000100:00100000:2.0:1788850946.996364:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850946.996438:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647360 00000100:00100000:2.0:1788850946.996447:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647360 00000100:00100000:2.0:1788850946.996492:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788850946.996502:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019647360:12345-0@lo:41: 00000004:00000024:2.0:1788850946.996535:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788850946.996581:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019647360:12345-0@lo:41: Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850946.996589:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788850946.996847:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019647360:0@lo:41: 00010000:00010000:3.0:1788850947.252171:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850948.023093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019647488:0@lo:400: 00000100:00100000:2.0:1788850948.023171:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023218:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019648000:0@lo:400: 00000100:00100000:2.0:1788850948.023244:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023273:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019648512:0@lo:400: 00000100:00100000:2.0:1788850948.023296:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023322:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788850948.023329:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019647872:0@lo:400: 00000100:00100000:2.0:1788850948.023351:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023368:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019648384:0@lo:400: 00000100:00100000:2.0:1788850948.023387:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023411:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019647744:0@lo:400: 00000100:00100000:2.0:1788850948.023430:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023446:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019648256:0@lo:400: 00000100:00100000:2.0:1788850948.023464:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023479:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019648768:0@lo:400: 00000100:00100000:2.0:1788850948.023501:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023519:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788850948.023524:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019647616:0@lo:400: 00000100:00100000:2.0:1788850948.023542:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023556:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019648128:0@lo:400: 00000100:00100000:2.0:1788850948.023574:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023584:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019648640:0@lo:400: 00000100:00100000:2.0:1788850948.023603:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.023627:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647488 00000100:00100000:2.0:1788850948.023634:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647488 00000100:00100000:2.0:1788850948.023678:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788850948.023687:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:3648:x1875746019647488:12345-0@lo:400: 00000100:00100000:2.0:1788850948.023736:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:3648:x1875746019647488:12345-0@lo:400: Request processed in 50us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.023750:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788850948.023862:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648000 00000100:00100000:2.0:1788850948.023867:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648000 00000100:00100000:2.0:1788850948.023885:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647744 00000100:00100000:2.0:1788850948.023887:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647744 00000100:00100000:2.0:1788850948.023899:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788850948.023905:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019648000:12345-0@lo:400: 00000100:00100000:2.0:1788850948.023940:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019648000:12345-0@lo:400: Request processed in 35us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.023946:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788850948.023957:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788850948.023962:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019647744:12345-0@lo:400: 00000100:00100000:2.0:1788850948.023991:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019647744:12345-0@lo:400: Request processed in 29us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.023997:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788850948.024034:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648512 00000100:00100000:2.0:1788850948.024038:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648512 00000100:00100000:2.0:1788850948.024069:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648384 00000100:00100000:2.0:1788850948.024072:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648384 00000100:00100000:2.0:1788850948.024090:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788850948.024096:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019648512:12345-0@lo:400: 00000100:00100000:2.0:1788850948.024125:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019648512:12345-0@lo:400: Request processed in 30us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.024130:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788850948.024140:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788850948.024146:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019648384:12345-0@lo:400: 00000100:00100000:2.0:1788850948.024168:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019648384:12345-0@lo:400: Request processed in 22us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.024180:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788850948.024196:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647872 00000100:00100000:2.0:1788850948.024199:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647872 00000100:00100000:2.0:1788850948.024212:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648256 00000100:00100000:2.0:1788850948.024214:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648256 00000100:00100000:2.0:1788850948.024225:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648768 00000100:00100000:2.0:1788850948.024227:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648768 00000100:00100000:2.0:1788850948.024238:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647616 00000100:00100000:2.0:1788850948.024240:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647616 00000100:00100000:2.0:1788850948.024248:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648128 00000100:00100000:2.0:1788850948.024250:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648128 00000100:00100000:2.0:1788850948.024259:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648640 00000100:00100000:2.0:1788850948.024261:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648640 00000100:00100000:2.0:1788850948.024273:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788850948.024277:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019647872:12345-0@lo:400: 00000100:00100000:2.0:1788850948.024302:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019647872:12345-0@lo:400: Request processed in 24us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.024307:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788850948.024317:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850948.024323:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019648256:12345-0@lo:400: 00000100:00100000:2.0:1788850948.024341:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019648256:12345-0@lo:400: Request processed in 19us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.024347:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850948.024355:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788850948.024360:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019648768:12345-0@lo:400: 00000100:00100000:2.0:1788850948.024378:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019648768:12345-0@lo:400: Request processed in 19us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.024384:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788850948.024402:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788850948.024406:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019647616:12345-0@lo:400: 00000100:00100000:2.0:1788850948.024429:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019647616:12345-0@lo:400: Request processed in 22us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.024434:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788850948.024442:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788850948.024447:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019648128:12345-0@lo:400: 00000100:00100000:2.0:1788850948.024467:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019648128:12345-0@lo:400: Request processed in 20us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.024472:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788850948.024480:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788850948.024484:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019648640:12345-0@lo:400: 00000100:00100000:2.0:1788850948.024503:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019648640:12345-0@lo:400: Request processed in 19us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.024508:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788850948.024540:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788850948.024544:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788850948.024547:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788850948.024578:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5990000 x1875746019647616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.024593:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019647616:0@lo:400: 00010000:00080000:2.0:1788850948.024604:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9b480 x1875746019648128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.024611:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019648128:0@lo:400: 00010000:00080000:2.0:1788850948.024620:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a98000 x1875746019648640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.024640:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019648640:0@lo:400: 00000100:00100000:2.0:1788850948.024653:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019647744:0@lo:400: 00010000:00080000:2.0:1788850948.024661:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a99180 x1875746019648256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.024669:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019648256:0@lo:400: 00010000:00080000:2.0:1788850948.024678:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9a300 x1875746019648768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.024684:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019648768:0@lo:400: 00010000:00080000:2.0:1788850948.024722:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5ad6a00 x1875746019647872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.024730:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019647872:0@lo:400: 00010000:00080000:2.0:1788850948.024739:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9b100 x1875746019648384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.024745:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019648384:0@lo:400: 00000100:00100000:2.0:1788850948.024752:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019647488:0@lo:400: 00000100:00100000:2.0:1788850948.024761:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019648000:0@lo:400: 00010000:00080000:2.0:1788850948.024769:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9aa00 x1875746019648512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.024776:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019648512:0@lo:400: 00010000:00010000:3.0:1788850948.276158:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788850948.532349:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788850948.532357:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ea5900800 from 39 10000000:01000000:3.0:1788850948.532363:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788850948.532410:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850948.532422:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850948.532434:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850948.532457:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019648896:0@lo:101: 00000100:00100000:3.0:1788850948.532547:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850948.532604:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e83764a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.532615:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648896 00000100:00100000:0.0:1788850948.532623:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648896 00000100:00100000:0.0:1788850948.532670:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788850948.532679:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019648896:12345-0@lo:101: 00010000:00010000:0.0:1788850948.532692:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850948.532705:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20583a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.532741:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20583a expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.532750:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20583a expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.532759:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433ce00, rc 0) 00000100:00100000:0.0:1788850948.532811:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019648896:12345-0@lo:101: Request processed in 133us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.532818:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788850948.532869:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019648896:0@lo:101: 00010000:00010000:0.0:1788850948.532882:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.532891:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850948.532947:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649024:0@lo:501: 00000100:00100000:0.0:1788850948.532970:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.532985:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993540 going to sleep for 11 seconds 00000100:00100000:3.0:1788850948.532991:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649024 00000100:00100000:3.0:1788850948.532995:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649024 00000100:00100000:3.0:1788850948.533042:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788850948.533049:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019649024:12345-0@lo:501: 00000100:00100000:3.0:1788850948.533165:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019649024:12345-0@lo:501: Request processed in 116us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850948.533172:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788850948.534297:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649024:0@lo:501: 00000100:00100000:0.0:1788850948.534339:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649152:0@lo:503: 00000100:00100000:0.0:1788850948.534393:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.534440:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993540 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.537373:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649152 00000100:00100000:1.0:1788850948.537388:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649152 00000100:00100000:1.0:1788850948.537439:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788850948.537449:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019649152:12345-0@lo:503: 00000100:00100000:1.0:1788850948.537611:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019649152:12345-0@lo:503: Request processed in 164us (3216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.537620:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788850948.537798:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649152:0@lo:503: 00000100:00100000:0.0:1788850948.538098:0:9870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9870:1875746019649280:0@lo:502: 00000100:00100000:0.0:1788850948.538144:0:9870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.538169:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649280 00000100:00100000:0.0:1788850948.538173:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649280 00000100:00100000:0.0:1788850948.538193:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788850948.538199:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9870:x1875746019649280:12345-0@lo:502: 00000100:00100000:0.0:1788850948.539429:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9870:x1875746019649280:12345-0@lo:502: Request processed in 1225us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.539439:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788850948.541440:0:9870:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.541550:0:9870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9870:1875746019649280:0@lo:502: 00000100:00100000:0.0:1788850948.541625:0:9870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9870:1875746019649408:0@lo:502: 00000100:00100000:0.0:1788850948.541686:0:9870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.541719:0:9870:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.541819:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649408 00000100:00100000:1.0:1788850948.541825:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649408 00000100:00100000:1.0:1788850948.541859:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788850948.541868:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9870:x1875746019649408:12345-0@lo:502: 00000100:00100000:1.0:1788850948.541988:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:9870:x1875746019649408:12345-0@lo:502: Request processed in 121us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.541995:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788850948.543629:0:9870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9870:1875746019649408:0@lo:502: 00000040:00080000:0.0:1788850948.543667:0:9870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788850948.543927:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788850948.543950:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788850948.543962:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.543974:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850948.543984:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788850948.543986:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788850948.543989:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788850948.544049:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.544058:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.544068:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850948.544085:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649536:0@lo:101: 00000100:00100000:1.0:1788850948.544141:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.544177:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6eb0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788850948.547825:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649536 00000100:00100000:3.0:1788850948.547839:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649536 00000100:00100000:3.0:1788850948.547901:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788850948.547912:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019649536:12345-0@lo:101: 00010000:00010000:3.0:1788850948.547941:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850948.547962:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205848 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850948.547991:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205848 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850948.548002:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205848 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850948.548027:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2154e00, rc 0) 00000100:00100000:3.0:1788850948.548105:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019649536:12345-0@lo:101: Request processed in 194us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850948.548112:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788850948.548701:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649536:0@lo:101: 00010000:00010000:1.0:1788850948.548722:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.548732:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850948.548818:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649664:0@lo:501: 00000100:00100000:1.0:1788850948.548855:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.548887:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6eb0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.548901:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649664 00000100:00100000:1.0:1788850948.548906:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649664 00000100:00100000:1.0:1788850948.548938:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788850948.548945:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019649664:12345-0@lo:501: 00000100:00100000:1.0:1788850948.549094:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019649664:12345-0@lo:501: Request processed in 149us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.549101:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788850948.549138:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649664:0@lo:501: 00000100:00100000:1.0:1788850948.549163:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649792:0@lo:503: 00000100:00100000:1.0:1788850948.549318:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.549333:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6eb0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.549345:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649792 00000100:00100000:1.0:1788850948.549349:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649792 00000100:00100000:1.0:1788850948.549370:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788850948.549376:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019649792:12345-0@lo:503: 00000100:00100000:1.0:1788850948.549450:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019649792:12345-0@lo:503: Request processed in 73us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.549457:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788850948.549569:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019649792:0@lo:503: 00000100:00100000:2.0:1788850948.554727:0:9873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9873:1875746019649920:0@lo:502: 00000100:00100000:2.0:1788850948.554827:0:9873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.554871:0:9873:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.554971:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649920 00000100:00100000:1.0:1788850948.554979:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649920 00000100:00100000:1.0:1788850948.555049:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788850948.555059:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9873:x1875746019649920:12345-0@lo:502: 00000100:00100000:1.0:1788850948.555188:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9873:x1875746019649920:12345-0@lo:502: Request processed in 129us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.555196:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788850948.555250:0:9873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9873:1875746019649920:0@lo:502: 00000020:01000000:1.0:1788850948.555276:0:9873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850948.555284:0:9873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850948.555287:0:9873:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788850948.555291:0:9873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788850948.555293:0:9873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788850948.555308:0:9873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9873:1875746019650048:0@lo:502: 00000100:00100000:1.0:1788850948.555344:0:9873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.555366:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650048 00000100:00100000:1.0:1788850948.555370:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650048 00000100:00100000:1.0:1788850948.555390:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788850948.555396:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9873:x1875746019650048:12345-0@lo:502: 00000100:00100000:1.0:1788850948.555448:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:9873:x1875746019650048:12345-0@lo:502: Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.555455:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788850948.556151:0:9873:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6eb0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.556168:0:9873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9873:1875746019650048:0@lo:502: 00000020:01000000:1.0:1788850948.556189:0:9873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850948.556194:0:9873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850948.556196:0:9873:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788850948.556200:0:9873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788850948.559155:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788850948.559308:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788850948.559321:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.559333:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850948.559345:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788850948.559348:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ebbbf6000 from 39 10000000:01000000:2.0:1788850948.559351:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788850948.559390:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.559399:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.559409:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850948.559433:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650176:0@lo:101: 00000100:00100000:2.0:1788850948.559503:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.559548:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.559719:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650176 00000100:00100000:1.0:1788850948.559727:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650176 00000100:00100000:2.0:1788850948.559868:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788850948.559878:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019650176:12345-0@lo:101: 00010000:00010000:2.0:1788850948.559891:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850948.559904:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205856 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.559943:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205856 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.559954:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205856 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.559962:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827ea600, rc 0) 00000100:00100000:2.0:1788850948.560008:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019650176:12345-0@lo:101: Request processed in 133us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.560034:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788850948.560088:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650176:0@lo:101: 00010000:00010000:1.0:1788850948.560101:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.560111:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850948.560167:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650304:0@lo:501: 00000100:00100000:1.0:1788850948.560196:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.560230:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6eb0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.560274:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650304 00000100:00100000:2.0:1788850948.560279:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650304 00000100:00100000:2.0:1788850948.560310:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788850948.560317:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019650304:12345-0@lo:501: 00000100:00100000:2.0:1788850948.560482:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019650304:12345-0@lo:501: Request processed in 163us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.560490:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788850948.564536:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650304:0@lo:501: 00000100:00100000:0.0:1788850948.564595:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650432:0@lo:503: 00000100:00100000:0.0:1788850948.564660:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.564701:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993540 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.564789:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650432 00000100:00100000:1.0:1788850948.564797:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650432 00000100:00100000:1.0:1788850948.564861:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788850948.564870:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019650432:12345-0@lo:503: 00000100:00100000:1.0:1788850948.564989:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019650432:12345-0@lo:503: Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.564995:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788850948.565164:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650432:0@lo:503: 00000100:00100000:0.0:1788850948.566330:0:9874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9874:1875746019650560:0@lo:502: 00000100:00100000:0.0:1788850948.566382:0:9874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.566401:0:9874:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788850948.566491:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650560 00000100:00100000:3.0:1788850948.566498:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650560 00000100:00100000:3.0:1788850948.566540:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788850948.566548:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:9874:x1875746019650560:12345-0@lo:502: 00000100:00100000:3.0:1788850948.566652:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:9874:x1875746019650560:12345-0@lo:502: Request processed in 104us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850948.566658:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788850948.566906:0:9874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9874:1875746019650560:0@lo:502: 00000100:00100000:0.0:1788850948.566944:0:9874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9874:1875746019650688:0@lo:502: 00000100:00100000:0.0:1788850948.566971:0:9874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.567001:0:9874:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.567052:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650688 00000100:00100000:0.0:1788850948.567056:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650688 00000100:00100000:0.0:1788850948.567084:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788850948.567092:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:9874:x1875746019650688:12345-0@lo:502: 00000100:00100000:0.0:1788850948.567162:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:9874:x1875746019650688:12345-0@lo:502: Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.567179:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788850948.567209:0:9874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9874:1875746019650688:0@lo:502: 00000040:00080000:0.0:1788850948.567226:0:9874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788850948.568845:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788850948.568885:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788850948.568896:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.568909:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850948.568920:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788850948.568923:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892ebbbf6000 from 6 10000000:01000000:2.0:1788850948.568926:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788850948.568973:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.568981:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.568991:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850948.569037:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650816:0@lo:101: 00000100:00100000:2.0:1788850948.569100:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.569137:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.569207:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650816 00000100:00100000:0.0:1788850948.569214:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650816 00000100:00100000:0.0:1788850948.569257:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788850948.569265:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019650816:12345-0@lo:101: 00010000:00010000:0.0:1788850948.569276:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850948.569290:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433cc00/0x3e0030720b20586b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205864 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.569311:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433cc00/0x3e0030720b20586b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205864 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.569322:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433cc00/0x3e0030720b20586b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205864 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.569330:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433cc00, rc 0) 00000100:00100000:0.0:1788850948.569381:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019650816:12345-0@lo:101: Request processed in 117us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.569388:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788850948.569795:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650816:0@lo:101: 00010000:00010000:2.0:1788850948.569809:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.569819:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850948.569864:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650944:0@lo:256: 00000100:00100000:2.0:1788850948.569895:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.569919:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788850948.569985:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650944 00000100:00100000:3.0:1788850948.569991:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650944 00000100:00100000:3.0:1788850948.570048:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788850948.570056:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019650944:12345-0@lo:256: 20000000:01000000:3.0:1788850948.570070:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788850948.570099:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788850948.570102:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788850948.570383:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019650944:12345-0@lo:256: Request processed in 327us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850948.570390:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788850948.570571:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019650944:0@lo:256: 10000000:01000000:2.0:1788850948.570616:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788850948.570623:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.570645:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850948.570659:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788850948.570661:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788850948.570664:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788850948.570683:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.570691:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.570700:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850948.570712:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019651072:0@lo:101: 00000100:00100000:2.0:1788850948.570735:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.570761:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788850948.570861:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651072 00000100:00100000:3.0:1788850948.570866:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651072 00000100:00100000:3.0:1788850948.570897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788850948.570904:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019651072:12345-0@lo:101: 00010000:00010000:3.0:1788850948.570912:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850948.570923:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205872 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850948.570942:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205872 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850948.570950:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205872 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850948.570957:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2155e00, rc 0) 00000100:00100000:3.0:1788850948.570985:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019651072:12345-0@lo:101: Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850948.570991:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788850948.571541:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019651072:0@lo:101: 00010000:00010000:2.0:1788850948.571555:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.571563:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850948.571617:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019651200:0@lo:501: 00000100:00100000:2.0:1788850948.571742:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.571782:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb840 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.571794:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651200 00000100:00100000:2.0:1788850948.571798:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651200 00000100:00100000:2.0:1788850948.571879:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788850948.571896:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019651200:12345-0@lo:501: 00000100:00100000:2.0:1788850948.572038:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019651200:12345-0@lo:501: Request processed in 141us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.572045:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788850948.584637:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019651200:0@lo:501: 00000100:00100000:3.0:1788850948.584698:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019651328:0@lo:503: 00000100:00100000:3.0:1788850948.584782:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850948.584830:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.587625:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651328 00000100:00100000:2.0:1788850948.587702:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651328 00000100:00100000:2.0:1788850948.587756:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788850948.587764:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019651328:12345-0@lo:503: 00000100:00100000:2.0:1788850948.587933:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019651328:12345-0@lo:503: Request processed in 169us (3161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.587941:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788850948.588891:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019651328:0@lo:503: 00000100:00100000:2.0:1788850948.591224:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9879:1875746019651456:0@lo:502: 00000100:00100000:2.0:1788850948.591303:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.591350:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651456 00000100:00100000:2.0:1788850948.591357:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651456 00000100:00100000:2.0:1788850948.591397:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788850948.591406:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:9879:x1875746019651456:12345-0@lo:502: 00000100:00100000:2.0:1788850948.593815:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:9879:x1875746019651456:12345-0@lo:502: Request processed in 2402us (2504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.593829:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788850948.593896:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.593921:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9879:1875746019651456:0@lo:502: 00000020:01000000:2.0:1788850948.593953:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788850948.593961:0:9879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788850948.593969:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850948.593977:0:9879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788850948.593983:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788850948.593987:0:9879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:2.0:1788850948.594038:0:9879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788850948.594041:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788850948.594064:0:9879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff892d87ac4d40) 00000020:00000080:2.0:1788850948.599201:0:9879:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788850948.599663:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788850948.599760:0:9879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788850948.599768:0:9879:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788850948.599787:0:9879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b205887 00010000:00080000:0.0:1788850948.599827:0:9879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892ea5933800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788850948.600062:0:9879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788850948.600203:0:9879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788850948.600217:0:9879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788850948.600391:0:9879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850948.601637:0:9879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850948.601790:0:9879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788850948.601880:0:9879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788850948.604891:0:9880:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788850948.604899:0:9880:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788850948.608937:0:9879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788850948.608952:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788850948.608999:0:9879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788850948.609043:0:9879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b20588e 00000100:00080000:0.0:1788850948.609055:0:9879:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788850948.609067:0:9879:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892ea5933800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788850948.609123:0:9879:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d87489c00 x1875746019651584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788850948.609148:0:9879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788850948.609203:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850948.609207:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850948.609209:0:9879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788850948.609212:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850948.609216:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850948.609218:0:9879:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788850948.609228:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788850948.609230:0:9879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788850948.609257:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9879:1875746019651712:0@lo:502: 00000100:00100000:0.0:1788850948.609334:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.609372:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea4342540 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.609395:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651712 00000100:00100000:0.0:1788850948.609402:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651712 00000100:00100000:0.0:1788850948.609446:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788850948.609455:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:9879:x1875746019651712:12345-0@lo:502: 00000100:00100000:3.0:1788850948.609833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019651584:0@lo:8: 00000100:00100000:3.0:1788850948.609871:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850948.609911:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651584 00000100:00100000:3.0:1788850948.609923:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651584 00000100:00100000:3.0:1788850948.609946:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788850948.609951:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019651584:12345-0@lo:8: 00010000:00080000:3.0:1788850948.609977:0:8447:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:3.0:1788850948.610007:0:8447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b205895 00002000:00100000:3.0:1788850948.610038:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff892ea5b9a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788850948.610043:0:8447:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788850948.610047:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788850948.610113:0:8447:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788850948.610365:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788850948.610389:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892ea5b99800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850948.610444:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875746019651584:12345-0@lo:8: Request processed in 491us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850948.610452:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788850948.610515:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87489c00 x1875746019651584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850948.610526:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788850948.610533:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788850948.610540:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788850948.610545:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788850948.610548:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5933800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788850948.610556:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788850948.610561:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019651584:0@lo:8: 00000004:00080000:2.0:1788850948.611443:0:9880:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788850948.611518:0:9880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 282670504218ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788850948.611525:0:9880:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788850948.613846:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:9879:x1875746019651712:12345-0@lo:502: Request processed in 4383us (4503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.613861:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788850948.613962:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1875746019651840:0@lo:700: 00000100:00100000:0.0:1788850948.614000:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.614050:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651840 00000100:00100000:0.0:1788850948.614057:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651840 00000100:00100000:0.0:1788850948.614107:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850948.614116:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9881:x1875746019651840:12345-0@lo:700: 00000100:00100000:0.0:1788850948.614146:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8457:1875746019651968:0@lo:700: 00000100:00100000:0.0:1788850948.614175:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.614193:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c646c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788850948.614208:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850948.614222:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651968 00000100:00100000:0.0:1788850948.614225:0:6541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651968 00000100:00100000:0.0:1788850948.614252:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850948.614258:0:6541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8457:x1875746019651968:12345-0@lo:700: 00000100:00100000:0.0:1788850948.614354:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea590a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.614647:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9879:1875746019651712:0@lo:502: 00000020:01000000:2.0:1788850948.614682:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850948.614690:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850948.614693:0:9879:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788850948.614698:0:9879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1788850948.614846:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788850948.614869:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788850948.614879:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.614890:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850948.614902:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788850948.614904:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892e91596800 from 39 10000000:01000000:2.0:1788850948.614907:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788850948.614932:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.614953:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.614963:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850948.614976:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652096:0@lo:101: 00000100:00100000:2.0:1788850948.615033:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.615055:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea4342540 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.615068:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652096 00000100:00100000:2.0:1788850948.615071:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652096 00000100:00100000:2.0:1788850948.615096:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788850948.615103:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019652096:12345-0@lo:101: 00010000:00010000:2.0:1788850948.615111:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850948.615135:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20589c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.615157:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20589c expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.615167:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20589c expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.615176:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7200, rc 0) 00000100:00100000:2.0:1788850948.615208:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019652096:12345-0@lo:101: Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.615215:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788850948.615248:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652096:0@lo:101: 00010000:00010000:2.0:1788850948.615267:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850948.615276:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850948.615321:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652224:0@lo:501: 00000100:00100000:2.0:1788850948.615346:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.615357:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea4342540 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.615590:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652224 00000100:00100000:0.0:1788850948.615599:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652224 00000100:00100000:0.0:1788850948.615628:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788850948.615635:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019652224:12345-0@lo:501: 00000100:00100000:0.0:1788850948.615743:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019652224:12345-0@lo:501: Request processed in 109us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.615750:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788850948.615935:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652224:0@lo:501: 00000100:00100000:0.0:1788850948.615960:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652352:0@lo:503: 00000100:00100000:0.0:1788850948.615991:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.616002:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.616031:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652352 00000100:00100000:0.0:1788850948.616034:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652352 00000100:00100000:0.0:1788850948.616053:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788850948.616057:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019652352:12345-0@lo:503: 00000100:00100000:0.0:1788850948.616121:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019652352:12345-0@lo:503: Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.616127:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788850948.616160:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652352:0@lo:503: 00000100:00100000:0.0:1788850948.622852:0:9882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9882:1875746019652480:0@lo:502: 00000100:00100000:0.0:1788850948.622934:0:9882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.622970:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652480 00000100:00100000:0.0:1788850948.622976:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652480 00000100:00100000:0.0:1788850948.623056:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788850948.623065:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:9882:x1875746019652480:12345-0@lo:502: 00000100:00100000:0.0:1788850948.623204:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:9882:x1875746019652480:12345-0@lo:502: Request processed in 139us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.623222:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788850948.623297:0:9882:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.623321:0:9882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9882:1875746019652480:0@lo:502: 00000100:00100000:0.0:1788850948.623369:0:9882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9882:1875746019652608:0@lo:502: 00000100:00100000:0.0:1788850948.623399:0:9882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.623421:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652608 00000100:00100000:0.0:1788850948.623425:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652608 00000100:00100000:0.0:1788850948.623445:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788850948.623451:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:9882:x1875746019652608:12345-0@lo:502: 00000100:00100000:0.0:1788850948.623505:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:9882:x1875746019652608:12345-0@lo:502: Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.623512:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788850948.623537:0:9882:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.623547:0:9882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9882:1875746019652608:0@lo:502: 00000040:00080000:0.0:1788850948.623564:0:9882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788850948.623621:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788850948.623645:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788850948.623655:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.623667:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850948.623676:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788850948.623679:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e91596800 from 6 10000000:01000000:0.0:1788850948.623682:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788850948.623704:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.623719:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.623729:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850948.623741:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652736:0@lo:101: 00000100:00100000:0.0:1788850948.623765:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.623791:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.623804:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652736 00000100:00100000:0.0:1788850948.623808:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652736 00000100:00100000:0.0:1788850948.623828:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788850948.623834:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019652736:12345-0@lo:101: 00010000:00010000:0.0:1788850948.623845:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850948.623856:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433d000/0x3e0030720b2058b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2058aa expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.623874:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d000/0x3e0030720b2058b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2058aa expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.623884:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433d000/0x3e0030720b2058b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2058aa expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.623891:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d000, rc 0) 00000100:00100000:0.0:1788850948.623916:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019652736:12345-0@lo:101: Request processed in 82us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.623921:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788850948.623949:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652736:0@lo:101: 00010000:00010000:0.0:1788850948.623967:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.623975:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850948.624038:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652864:0@lo:256: 00000100:00100000:0.0:1788850948.624067:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.624078:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.624089:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652864 00000100:00100000:0.0:1788850948.624092:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652864 00000100:00100000:0.0:1788850948.624112:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788850948.624117:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019652864:12345-0@lo:256: 20000000:01000000:0.0:1788850948.624130:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788850948.624149:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788850948.624152:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788850948.625893:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019652864:12345-0@lo:256: Request processed in 1766us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.625907:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788850948.625974:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652864:0@lo:256: 10000000:01000000:0.0:1788850948.626045:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788850948.626054:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.626064:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850948.626073:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788850948.626083:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788850948.626086:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788850948.626116:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.626123:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.626134:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850948.626150:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652992:0@lo:101: 00000100:00100000:0.0:1788850948.626179:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.626197:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.626214:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652992 00000100:00100000:0.0:1788850948.626220:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652992 00000100:00100000:0.0:1788850948.626251:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788850948.626259:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019652992:12345-0@lo:101: 00010000:00010000:0.0:1788850948.626271:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850948.626282:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2058b8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.626306:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2058b8 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.626316:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2058b8 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.626325:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433c200, rc 0) 00000100:00100000:0.0:1788850948.626353:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019652992:12345-0@lo:101: Request processed in 95us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.626364:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788850948.626396:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019652992:0@lo:101: 00010000:00010000:0.0:1788850948.626407:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850948.626415:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850948.626460:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019653120:0@lo:501: 00000004:00080000:2.0:1788850948.626807:0:7465:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:2.0:1788850948.629170:0:6541:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788850948.632176:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.632220:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.635685:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653120 00000100:00100000:0.0:1788850948.635699:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653120 00000100:00100000:0.0:1788850948.635752:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788850948.635762:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019653120:12345-0@lo:501: 00000100:00100000:0.0:1788850948.635944:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019653120:12345-0@lo:501: Request processed in 183us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.635952:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788850948.636007:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019653120:0@lo:501: 00000100:00100000:0.0:1788850948.636066:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019653248:0@lo:503: 00000100:00100000:0.0:1788850948.636112:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.636141:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850948.636154:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653248 00000100:00100000:0.0:1788850948.636157:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653248 00000100:00100000:0.0:1788850948.636178:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788850948.636183:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019653248:12345-0@lo:503: 00000100:00100000:0.0:1788850948.636265:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019653248:12345-0@lo:503: Request processed in 80us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.636272:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788850948.636313:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019653248:0@lo:503: 00000100:00100000:1.0:1788850948.636679:0:9883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9883:1875746019653376:0@lo:502: 00000100:00100000:1.0:1788850948.636719:0:9883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.636740:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653376 00000100:00100000:1.0:1788850948.636744:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653376 00000100:00100000:1.0:1788850948.636778:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788850948.636785:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:9883:x1875746019653376:12345-0@lo:502: 00000100:00100000:1.0:1788850948.636861:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:9883:x1875746019653376:12345-0@lo:502: Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.636867:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788850948.636898:0:9883:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9068b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.636909:0:9883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9883:1875746019653376:0@lo:502: 00000020:01000000:1.0:1788850948.636931:0:9883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788850948.636938:0:9883:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788850948.636944:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850948.636947:0:9883:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788850948.636951:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788850948.636955:0:9883:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:1.0:1788850948.636976:0:9883:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788850948.636978:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788850948.636993:0:9883:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff892d874a4d40) 00000020:00000080:1.0:1788850948.637028:0:9883:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788850948.637035:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788850948.637112:0:9883:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788850948.637117:0:9883:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788850948.637125:0:9883:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b2058cd 00010000:00080000:1.0:1788850948.637151:0:9883:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d85c50000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1788850948.637355:0:9883:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788850948.639602:0:9883:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788850948.639620:0:9883:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788850948.640363:0:9883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850948.642236:0:9883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850948.642380:0:9883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788850948.645632:0:9883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788850948.646799:0:9884:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788850948.646805:0:9884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788850948.647736:0:6541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8457:x1875746019651968:12345-0@lo:700: Request processed in 33471us (33554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.647749:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788850948.647815:0:8457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8748ad80 x1875746019651968/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.647830:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8457:1875746019651968:0@lo:700: 40000000:02000000:2.0:1788850948.647845:0:8457:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:00000080:1.0:1788850948.662111:0:9883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788850948.662128:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788850948.662174:0:9883:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788850948.662202:0:9883:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b2058d4 00000100:00080000:1.0:1788850948.662212:0:9883:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788850948.662223:0:9883:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892d85c50000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788850948.662262:0:9883:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e83e1b100 x1875746019653504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788850948.662291:0:9883:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788850948.662345:0:9883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850948.662350:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850948.662351:0:9883:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788850948.662354:0:9883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850948.662358:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850948.662359:0:9883:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788850948.662361:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788850948.662363:0:9883:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788850948.662389:0:9883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9883:1875746019653632:0@lo:502: 00000100:00100000:0.0:1788850948.662702:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019653504:0@lo:8: 00000100:00100000:0.0:1788850948.662747:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.665683:0:9883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.665789:0:9883:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.671623:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653504 00000100:00100000:2.0:1788850948.671638:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653504 00000100:00100000:2.0:1788850948.671691:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788850948.671699:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875746019653504:12345-0@lo:8: 00010000:00080000:2.0:1788850948.671735:0:8449:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1788850948.671768:0:8449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b2058db 00002000:00100000:2.0:1788850948.671794:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff892d879a0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788850948.671799:0:8449:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788850948.671816:0:8449:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788850948.671888:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788850948.671914:0:8449:0:(import.c:65:import_set_state_nolock()) ffff892d879a3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788850948.672004:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875746019653504:12345-0@lo:8: Request processed in 305us (9257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.672042:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788850948.672130:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1b100 x1875746019653504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.672143:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788850948.672152:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788850948.672160:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788850948.672166:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788850948.672169:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c50000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788850948.672189:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788850948.672195:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019653504:0@lo:8: 00000004:00080000:1.0:1788850948.673110:0:9884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788850948.673166:0:9884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 282732152714ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788850948.673174:0:9884:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788850948.678567:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653632 00000100:00100000:0.0:1788850948.678582:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653632 00000100:00100000:0.0:1788850948.678640:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788850948.678651:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:9883:x1875746019653632:12345-0@lo:502: 00000100:00100000:0.0:1788850948.678828:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:9883:x1875746019653632:12345-0@lo:502: Request processed in 178us (13152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.678836:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788850948.681699:0:9883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:9883:1875746019653632:0@lo:502: 00000020:01000000:1.0:1788850948.681748:0:9883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850948.681757:0:9883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850948.681759:0:9883:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788850948.681765:0:9883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788850948.681916:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788850948.681938:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788850948.681948:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.681960:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850948.681971:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788850948.681974:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff892ebbbc99c0 from 1 10000000:01000000:1.0:1788850948.681976:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788850948.682025:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.682033:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.682041:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850948.682072:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019653760:0@lo:101: 00000100:00100000:1.0:1788850948.682131:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.682165:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.682182:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653760 00000100:00100000:1.0:1788850948.682187:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653760 00000100:00100000:1.0:1788850948.682231:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788850948.682240:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019653760:12345-0@lo:101: 00010000:00010000:1.0:1788850948.682252:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850948.682264:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2058e2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.682285:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2058e2 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.682295:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2058e2 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.682304:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95000, rc 0) 00000100:00100000:1.0:1788850948.682337:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019653760:12345-0@lo:101: Request processed in 98us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.682344:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788850948.682377:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019653760:0@lo:101: 00010000:00010000:1.0:1788850948.682390:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850948.682399:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850948.682459:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019653888:0@lo:501: 00000100:00100000:1.0:1788850948.684629:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.684673:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788850948.687663:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653888 00000100:00100000:3.0:1788850948.687679:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653888 00000100:00100000:3.0:1788850948.687802:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788850948.687813:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019653888:12345-0@lo:501: 00000100:00100000:3.0:1788850948.687952:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019653888:12345-0@lo:501: Request processed in 142us (3329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788850948.687960:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788850948.688033:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019653888:0@lo:501: 10000000:01000000:3.0:1788850948.688074:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788850948.688085:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850948.688096:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788850948.688152:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788850948.688158:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788850948.688246:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9881:x1875746019651840:12345-0@lo:700: Request processed in 74132us (74245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850948.688254:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788850948.688399:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87488e00 x1875746019651840/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850948.688411:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1875746019651840:0@lo:700: 00000004:00080000:3.0:1788850948.694653:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788850948.694751:0:9885:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788850948.694787:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9885:1875746019654144:0@lo:7: 00000100:00100000:3.0:1788850948.694859:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850948.694896:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654144 00000100:00100000:3.0:1788850948.694903:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654144 00000100:00100000:3.0:1788850948.694958:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788850948.694967:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9885:x1875746019654144:12345-0@lo:7: 00000100:00100000:0.0:1788850948.696395:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019654016:0@lo:13: 00000100:00100000:0.0:1788850948.696452:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788850948.696565:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850948.696585:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654016 00000100:00100000:0.0:1788850948.696591:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654016 00000100:00100000:0.0:1788850948.696627:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788850948.696634:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019654016:12345-0@lo:13: 00002000:00000024:0.0:1788850948.696657:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:0.0:1788850948.696696:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019654016:12345-0@lo:13: Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.696709:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788850948.696747:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ce00 x1875746019654016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850948.696767:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019654016:0@lo:13: 00000100:00100000:2.0:1788850948.698080:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7900 going to sleep for 11 seconds 00000004:00080000:1.0:1788850948.703549:0:9881:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788850948.703584:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1875746019654400:0@lo:7: 00000100:00100000:1.0:1788850948.703659:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.703689:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.703704:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788850948.703716:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019654272:0@lo:13: 00000100:00100000:1.0:1788850948.703743:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.703786:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654400 00000100:00100000:1.0:1788850948.703793:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654400 00000100:00100000:1.0:1788850948.703845:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788850948.703856:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9881:x1875746019654400:12345-0@lo:7: 00000100:00100000:1.0:1788850948.703912:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654272 00000100:00100000:1.0:1788850948.703915:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654272 00000100:00100000:1.0:1788850948.703938:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788850948.703944:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875746019654272:12345-0@lo:13: 00002000:00000024:1.0:1788850948.703959:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:1.0:1788850948.704004:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875746019654272:12345-0@lo:13: Request processed in 60us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.704034:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788850948.704076:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e18000 x1875746019654272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850948.704094:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019654272:0@lo:13: 00002000:00080000:2.0:1788850948.715054:0:8447:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788850948.715065:0:8447:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788850948.715165:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9885:x1875746019654144:12345-0@lo:7: Request processed in 20193us (20299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.715176:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788850948.719631:0:9885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ca80 x1875746019654144/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850948.719664:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9885:1875746019654144:0@lo:7: 00000004:00080000:3.0:1788850948.719682:0:9885:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788850948.719727:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9885:1875746019654528:0@lo:5: 00000100:00100000:3.0:1788850948.719800:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850948.719826:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.724224:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654528 00000100:00100000:2.0:1788850948.724237:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654528 00000100:00100000:2.0:1788850948.724286:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788850948.724295:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9885:x1875746019654528:12345-0@lo:5: 00002000:00080000:2.0:1788850948.724326:0:8450:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788850948.724330:0:8450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788850948.724882:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9885:x1875746019654528:12345-0@lo:5: Request processed in 585us (5080us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788850948.724898:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788850948.725137:0:9885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ca80 x1875746019654528/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850948.725155:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9885:1875746019654528:0@lo:5: 00000004:00080000:3.0:1788850948.725168:0:9885:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788850948.725206:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9885:1875746019654656:0@lo:700: 00000100:00100000:3.0:1788850948.725240:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850948.725267:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788850948.725324:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654656 00000100:00100000:1.0:1788850948.725330:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654656 00000100:00100000:1.0:1788850948.725371:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788850948.725380:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:9885:x1875746019654656:12345-0@lo:700: 00002000:00080000:1.0:1788850948.733454:0:8449:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788850948.733478:0:8449:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788850948.733582:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9881:x1875746019654400:12345-0@lo:7: Request processed in 29725us (29919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.733592:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000001:00080000:3.0:1788850948.734224:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:0.0:1788850948.734388:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1b100 x1875746019654400/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850948.734405:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1875746019654400:0@lo:7: 00000004:00080000:0.0:1788850948.734419:0:9881:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788850948.734458:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1875746019654784:0@lo:5: 00000100:00100000:0.0:1788850948.734511:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850948.734551:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.735860:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9885:x1875746019654656:12345-0@lo:700: Request processed in 10478us (10615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.735876:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788850948.736761:0:9885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590d180 x1875746019654656/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850948.736786:0:9885:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788850948.736804:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9885:1875746019654656:0@lo:700: 00000100:00100000:3.0:1788850948.739482:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654784 00000100:00100000:3.0:1788850948.739498:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654784 00000100:00100000:3.0:1788850948.739562:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788850948.739575:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9881:x1875746019654784:12345-0@lo:5: 00002000:00080000:3.0:1788850948.739607:0:8447:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788850948.739713:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9881:x1875746019654784:12345-0@lo:5: Request processed in 141us (5200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850948.739720:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788850948.739763:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87489180 x1875746019654784/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850948.739787:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1875746019654784:0@lo:5: 00000004:00080000:3.0:1788850948.739808:0:9881:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788850948.739854:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1875746019654912:0@lo:5: 00000100:00100000:3.0:1788850948.739890:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850948.739914:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.740811:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654912 00000100:00100000:2.0:1788850948.740824:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654912 00000100:00100000:2.0:1788850948.740865:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788850948.740874:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9881:x1875746019654912:12345-0@lo:5: 00002000:00080000:2.0:1788850948.740905:0:8625:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000004:02000040:3.0:1788850948.741448:0:9885:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788850948.750374:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9881:x1875746019654912:12345-0@lo:5: Request processed in 9494us (10476us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788850948.750387:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788850948.750457:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590dc00 x1875746019654912/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.752589:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9881:1875746019654912:0@lo:5: 00000004:00080000:2.0:1788850948.752604:0:9881:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788850948.752637:0:9881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a99180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9881:1875746019655168:0@lo:900: 00000100:00100000:2.0:1788850948.752694:0:9881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.752728:0:9881:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788850948.752754:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655168 00000100:00100000:2.0:1788850948.752760:0:6545:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655168 00000100:00100000:2.0:1788850948.753048:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850948.753058:0:6545:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9881:x1875746019655168:12345-0@lo:900: 00000100:00100000:2.0:1788850948.753111:0:6545:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9881:x1875746019655168:12345-0@lo:900: Request processed in 54us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.753117:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788850948.753168:0:9881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a99180 x1875746019655168/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.753178:0:9881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a99180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9881:1875746019655168:0@lo:900: 00000100:00100000:3.0:1788850948.753244:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9885:1875746019655040:0@lo:5: 00000100:00100000:3.0:1788850948.753282:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850948.753300:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead29f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850948.753315:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655040 00000100:00100000:3.0:1788850948.753319:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655040 00000100:00100000:3.0:1788850948.753350:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788850948.753356:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9885:x1875746019655040:12345-0@lo:5: 00002000:00080000:3.0:1788850948.775260:0:8447:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788850948.775283:0:8447:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788850948.777030:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9885:x1875746019655040:12345-0@lo:5: Request processed in 23649us (23724us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788850948.777044:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788850948.777592:0:9885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ca80 x1875746019655040/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850964 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850948.777609:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9885:1875746019655040:0@lo:5: 00000004:00080000:2.0:1788850948.777624:0:9885:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:0.0:1788850948.825878:0:9899:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788850949.044595:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788850949.044620:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019655296:0@lo:13: 00000100:00100000:2.0:1788850949.044686:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850949.044774:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655296 00000100:00100000:2.0:1788850949.044783:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655296 00000100:00100000:2.0:1788850949.044830:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788850949.044839:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019655296:12345-0@lo:13: 00002000:00000024:2.0:1788850949.044869:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850949.044910:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019655296:12345-0@lo:13: Request processed in 72us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850949.044917:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788850949.044954:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a99180 x1875746019655296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850949.044971:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019655296:0@lo:13: 00000100:00100000:0.0:1788850949.046347:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850949.046368:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019655424:0@lo:13: 00000100:00100000:0.0:1788850949.046426:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850949.046569:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655424 00000100:00100000:3.0:1788850949.046577:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655424 00000100:00100000:3.0:1788850949.046626:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788850949.046634:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019655424:12345-0@lo:13: 00002000:00000024:3.0:1788850949.046651:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850949.046708:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019655424:12345-0@lo:13: Request processed in 74us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850949.046715:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788850949.046753:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590c700 x1875746019655424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850949.046799:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019655424:0@lo:13: 00010000:00010000:2.0:1788850949.301347:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788850949.928437:0:9951:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788850949.928819:0:9951:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788850950.069407:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019655552:0@lo:41: 00000100:00100000:0.0:1788850950.069485:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850950.072942:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655552 00000100:00100000:3.0:1788850950.072966:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655552 00000100:00100000:3.0:1788850950.073075:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788850950.073088:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019655552:12345-0@lo:41: 00000004:00000024:3.0:1788850950.073141:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788850950.073241:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019655552:12345-0@lo:41: Request processed in 156us (3756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850950.073249:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788850950.073307:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019655552:0@lo:41: 00010000:00010000:3.0:1788850950.324413:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788850950.726535:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1788850950.726675:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788850951.348257:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850952.124075:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019655680:0@lo:41: 00000100:00100000:2.0:1788850952.124154:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850952.125240:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655680 00000100:00100000:0.0:1788850952.125252:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655680 00000100:00100000:0.0:1788850952.125316:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788850952.125326:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019655680:12345-0@lo:41: 00000004:00000024:0.0:1788850952.125363:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788850952.133589:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019655680:12345-0@lo:41: Request processed in 8252us (9423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850952.133606:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788850952.137226:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019655680:0@lo:41: 00010000:00010000:0.0:1788850952.372358:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788850952.771940:0:10052:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788850952.772429:0:10052:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788850953.401691:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788850953.692037:0:10100:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788850953.692049:0:10100:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1788850954.164259:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788850954.164284:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019655808:0@lo:13: 00000100:00100000:0.0:1788850954.164364:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850954.164445:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655808 00000100:00100000:0.0:1788850954.164453:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655808 00000100:00100000:0.0:1788850954.164504:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788850954.164514:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019655808:12345-0@lo:13: 00002000:00000024:0.0:1788850954.164540:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788850954.164580:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019655808:12345-0@lo:13: Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850954.164586:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788850954.164617:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788850954.164645:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87489180 x1875746019655808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850954.164655:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788850954.164685:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019655808:0@lo:13: 00000100:00100000:0.0:1788850954.164741:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019655936:0@lo:13: 00000100:00100000:2.0:1788850954.164771:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788850954.164782:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850954.164785:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019656064:0@lo:13: 00000100:00100000:0.0:1788850954.164821:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655936 00000100:00100000:2.0:1788850954.164826:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850954.164827:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655936 00000100:00100000:0.0:1788850954.164852:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656064 00000100:00100000:0.0:1788850954.164856:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656064 00000100:00100000:0.0:1788850954.164874:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788850954.164881:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019655936:12345-0@lo:13: 00002000:00000024:0.0:1788850954.164891:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788850954.164930:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019655936:12345-0@lo:13: Request processed in 50us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850954.164936:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788850954.164949:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788850954.164955:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019656064:12345-0@lo:13: 00002000:00000024:0.0:1788850954.164982:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1788850954.164996:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87489180 x1875746019655936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850954.165006:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788850954.165040:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019655936:0@lo:13: 00000100:00100000:0.0:1788850954.165044:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019656064:12345-0@lo:13: Request processed in 88us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850954.165052:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788850954.165070:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788850954.165074:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788850954.165085:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9ad80 x1875746019656064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850954.165098:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019656064:0@lo:13: 00000100:00100000:3.0:1788850954.165486:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788850954.165496:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019656320:0@lo:400: 00000100:00100000:3.0:1788850954.165541:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850954.165569:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656320 00000100:00100000:3.0:1788850954.165574:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656320 00000100:00100000:3.0:1788850954.165607:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788850954.165614:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019656320:12345-0@lo:400: 00000100:00100000:3.0:1788850954.165650:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019656320:12345-0@lo:400: Request processed in 37us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850954.165655:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788850954.165696:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ca80 x1875746019656320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850954.165719:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019656320:0@lo:400: 00000100:00100000:3.0:1788850954.165754:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019656448:0@lo:400: 00000100:00100000:3.0:1788850954.165780:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850954.165796:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019656192:0@lo:400: 00000100:00100000:3.0:1788850954.165804:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656448 00000100:00100000:3.0:1788850954.165808:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656448 00000100:00100000:0.0:1788850954.165826:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850954.165830:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788850954.165836:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019656448:12345-0@lo:400: 00000100:00100000:0.0:1788850954.165859:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656192 00000100:00100000:0.0:1788850954.165863:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656192 00000100:00100000:3.0:1788850954.165870:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019656448:12345-0@lo:400: Request processed in 34us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850954.165875:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788850954.165886:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788850954.165892:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019656192:12345-0@lo:400: 00000100:00100000:3.0:1788850954.165902:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019656448:0@lo:400: 00000100:00100000:0.0:1788850954.165923:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019656192:12345-0@lo:400: Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850954.165935:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788850954.165937:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788850954.165940:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019656832:0@lo:400: 00000100:00100000:3.0:1788850954.165960:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850954.165975:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019656704:0@lo:400: 00000100:00100000:3.0:1788850954.165994:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019656960:0@lo:400: 00000100:00100000:0.0:1788850954.165997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850954.166033:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019656192:0@lo:400: 00000100:00100000:3.0:1788850954.166039:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850954.166045:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788850954.166050:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019656576:0@lo:400: 00000100:00100000:0.0:1788850954.166071:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850954.166092:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656832 00000100:00100000:0.0:1788850954.166093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019657216:0@lo:400: 00000100:00100000:3.0:1788850954.166096:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656832 00000100:00100000:0.0:1788850954.166112:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850954.166119:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656960 00000100:00100000:3.0:1788850954.166121:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656960 00000100:00100000:0.0:1788850954.166124:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788850954.166128:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019657088:0@lo:400: 00000100:00100000:3.0:1788850954.166133:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656576 00000100:00100000:3.0:1788850954.166135:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656576 00000100:00100000:3.0:1788850954.166145:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657216 00000100:00100000:3.0:1788850954.166147:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657216 00000100:00100000:0.0:1788850954.166147:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850954.166160:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788850954.166166:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019656832:12345-0@lo:400: 00000100:00100000:0.0:1788850954.166167:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656704 00000100:00100000:0.0:1788850954.166170:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656704 00000100:00100000:0.0:1788850954.166191:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788850954.166197:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019656704:12345-0@lo:400: 00000100:00100000:3.0:1788850954.166202:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019656832:12345-0@lo:400: Request processed in 38us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850954.166208:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788850954.166220:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788850954.166226:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019656960:12345-0@lo:400: 00000100:00100000:0.0:1788850954.166226:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019656704:12345-0@lo:400: Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850954.166232:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788850954.166250:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019656960:12345-0@lo:400: Request processed in 25us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850954.166253:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019656704:0@lo:400: 00000100:00100000:3.0:1788850954.166255:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788850954.166265:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788850954.166270:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019656576:12345-0@lo:400: 00000100:00100000:0.0:1788850954.166286:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788850954.166293:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019657216:12345-0@lo:400: 00000100:00100000:3.0:1788850954.166298:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019656576:12345-0@lo:400: Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850954.166303:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788850954.166318:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019657216:12345-0@lo:400: Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850954.166324:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788850954.166327:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e15500 x1875746019657216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850954.166336:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019657216:0@lo:400: 00000100:00080000:0.0:1788850954.166342:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788850954.166345:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ca80 x1875746019656576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788850954.166346:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850954.166353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019656576:0@lo:400: 00010000:00080000:3.0:1788850954.166382:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e17800 x1875746019656960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850954.166390:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019656960:0@lo:400: 00010000:00080000:3.0:1788850954.166397:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e17480 x1875746019656832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850954.166414:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019656832:0@lo:400: 00000100:00100000:1.0:1788850954.166525:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657088 00000100:00100000:1.0:1788850954.166530:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657088 00000100:00100000:1.0:1788850954.166572:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788850954.166580:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019657088:12345-0@lo:400: 00000100:00100000:1.0:1788850954.166629:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019657088:12345-0@lo:400: Request processed in 50us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850954.166635:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788850954.166661:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e16d80 x1875746019657088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850954.166673:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019657344:0@lo:400: 00000100:00100000:2.0:1788850954.166689:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019657088:0@lo:400: 00000100:00100000:1.0:1788850954.166707:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850954.166724:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657344 00000100:00100000:1.0:1788850954.166728:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850954.166730:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657344 00000100:00100000:1.0:1788850954.166735:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019657472:0@lo:13: 00000100:00100000:1.0:1788850954.166759:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850954.166769:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788850954.166778:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019657344:12345-0@lo:400: 00000100:00100000:1.0:1788850954.166787:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657472 00000100:00100000:1.0:1788850954.166792:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657472 00000100:00100000:1.0:1788850954.166818:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788850954.166825:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019657472:12345-0@lo:13: 00002000:00000024:1.0:1788850954.166838:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850954.166839:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019657344:12345-0@lo:400: Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850954.166849:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788850954.166868:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019657472:12345-0@lo:13: Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850954.166881:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788850954.166909:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9ad80 x1875746019657472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850954.166920:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019657472:0@lo:13: 00010000:00080000:1.0:1788850954.166927:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e17480 x1875746019657344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850954.166934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019657344:0@lo:400: 00000100:00080000:3.0:1788850954.169487:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788850954.169550:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788850954.420284:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850955.197033:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788850955.197058:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019657600:0@lo:41: 00000100:00100000:3.0:1788850955.197128:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850955.197253:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657600 00000100:00100000:0.0:1788850955.197262:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657600 00000100:00100000:0.0:1788850955.197322:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788850955.197331:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019657600:12345-0@lo:41: 00000004:00000024:0.0:1788850955.197362:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788850955.197411:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019657600:12345-0@lo:41: Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850955.197418:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788850955.197752:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019657600:0@lo:41: 00000100:00100000:2.0:1788850955.250952:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850955.251071:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732544 00000100:00100000:3.0:1788850955.251099:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732544 00000100:00100000:3.0:1788850955.251163:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:3.0:1788850955.251174:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2406:x1875746000732544:12345-192.168.204.27@tcp:250: 00010000:00080000:3.0:1788850955.251212:0:6529:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f94a6f02-0dd4-4eeb-8749-5cfc5798f911@192.168.204.27@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:3.0:1788850955.251252:0:6529:0:(genops.c:1384:class_connect()) connect: client f94a6f02-0dd4-4eeb-8749-5cfc5798f911, cookie 0x3e0030720b2058f0 00000100:00080000:3.0:1788850955.251426:0:6529:0:(import.c:65:import_set_state_nolock()) ffff892d879db000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850955.251519:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+5:2406:x1875746000732544:12345-192.168.204.27@tcp:250: Request processed in 345us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850955.251528:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:0.0:1788850955.259180:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850955.259309:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732416 00000100:00100000:2.0:1788850955.259325:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732416 00000100:00100000:2.0:1788850955.259402:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:2.0:1788850955.259413:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+5:6178:x1875746000732416:12345-192.168.204.27@tcp:101: 00010000:00010000:2.0:1788850955.259446:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850955.259466:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c388d0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850955.259508:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d0 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850955.259521:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d0 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850955.259530:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6400, rc 0) 00000100:00100000:2.0:1788850955.259601:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+6:6178:x1875746000732416:12345-192.168.204.27@tcp:101: Request processed in 189us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850955.259608:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:2.0:1788850955.263713:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850955.263878:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732672 00000100:00100000:3.0:1788850955.263889:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732672 00000100:00100000:3.0:1788850955.263943:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:3.0:1788850955.263954:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+6:6178:x1875746000732672:12345-192.168.204.27@tcp:501: 00000100:00100000:3.0:1788850955.264108:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+6:6178:x1875746000732672:12345-192.168.204.27@tcp:501: Request processed in 155us (403us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788850955.264116:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:3.0:1788850955.266395:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850955.266567:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732800 00000100:00100000:0.0:1788850955.266577:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732800 00000100:00100000:0.0:1788850955.266621:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:0.0:1788850955.266631:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+6:6178:x1875746000732800:12345-192.168.204.27@tcp:101: 00010000:00010000:0.0:1788850955.266658:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850955.266687:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c388d7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850955.266716:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d7 expref: 7 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850955.266727:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d7 expref: 7 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850955.266736:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433c000, rc 0) 00000100:00100000:0.0:1788850955.266798:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+7:6178:x1875746000732800:12345-192.168.204.27@tcp:101: Request processed in 167us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850955.266819:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:0.0:1788850955.269452:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850955.269540:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732928 00000100:00100000:2.0:1788850955.269551:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732928 00000100:00100000:2.0:1788850955.269619:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:2.0:1788850955.269630:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+7:6178:x1875746000732928:12345-192.168.204.27@tcp:501: 00000100:00100000:2.0:1788850955.269865:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:6178:x1875746000732928:12345-192.168.204.27@tcp:501: Request processed in 235us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850955.269873:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:2.0:1788850955.272345:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850955.272426:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733056 00000100:00100000:3.0:1788850955.272445:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733056 00000100:00100000:3.0:1788850955.272498:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:3.0:1788850955.272507:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:6178:x1875746000733056:12345-192.168.204.27@tcp:503: 00000100:00100000:3.0:1788850955.272987:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:6178:x1875746000733056:12345-192.168.204.27@tcp:503: Request processed in 479us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850955.272995:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:1.0:1788850955.276170:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850955.276255:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733184 00000100:00100000:0.0:1788850955.276266:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733184 00000100:00100000:0.0:1788850955.276370:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:0.0:1788850955.276381:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:6196:x1875746000733184:12345-192.168.204.27@tcp:502: 00000100:00100000:0.0:1788850955.276539:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:6196:x1875746000733184:12345-192.168.204.27@tcp:502: Request processed in 160us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850955.276547:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:0.0:1788850955.298622:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850955.298900:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733312 00000100:00100000:3.0:1788850955.298910:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733312 00000100:00100000:3.0:1788850955.298968:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:3.0:1788850955.298978:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:6196:x1875746000733312:12345-192.168.204.27@tcp:502: 00000100:00100000:3.0:1788850955.299168:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:6196:x1875746000733312:12345-192.168.204.27@tcp:502: Request processed in 190us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850955.299176:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:3.0:1788850955.308848:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850955.311731:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733440 00000100:00100000:0.0:1788850955.311746:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733440 00000100:00100000:0.0:1788850955.311817:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:0.0:1788850955.311828:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:6178:x1875746000733440:12345-192.168.204.27@tcp:101: 00010000:00010000:0.0:1788850955.311845:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850955.311875:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433d800/0x3e0030720b205905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38908 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850955.311903:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d800/0x3e0030720b205905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38908 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850955.311913:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433d800/0x3e0030720b205905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38908 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850955.311921:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d800, rc 0) 00000100:00100000:0.0:1788850955.311990:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6178:x1875746000733440:12345-192.168.204.27@tcp:101: Request processed in 164us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850955.312038:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:1.0:1788850955.319527:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850955.319615:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733568 00000100:00100000:2.0:1788850955.319626:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733568 00000100:00100000:2.0:1788850955.319740:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:2.0:1788850955.319750:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6178:x1875746000733568:12345-192.168.204.27@tcp:256: 20000000:01000000:2.0:1788850955.319793:0:6526:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788850955.319810:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788850955.319813:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788850955.319817:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788850955.319819:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788850955.319822:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788850955.325463:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6178:x1875746000733568:12345-192.168.204.27@tcp:256: Request processed in 5703us (5934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850955.325485:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:0.0:1788850955.331598:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850955.331704:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733696 00000100:00100000:3.0:1788850955.331716:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733696 00000100:00100000:3.0:1788850955.331784:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:3.0:1788850955.331794:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6178:x1875746000733696:12345-192.168.204.27@tcp:101: 00010000:00010000:3.0:1788850955.331812:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850955.331831:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3890f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850955.331874:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3890f expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850955.331886:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3890f expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850955.331911:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2154800, rc 0) 00000100:00100000:3.0:1788850955.332133:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6178:x1875746000733696:12345-192.168.204.27@tcp:101: Request processed in 339us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850955.332510:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:1.0:1788850955.336847:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850955.336968:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733824 00000100:00100000:0.0:1788850955.336977:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733824 00000100:00100000:0.0:1788850955.337062:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:0.0:1788850955.337073:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6178:x1875746000733824:12345-192.168.204.27@tcp:501: 00000100:00100000:0.0:1788850955.338995:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6178:x1875746000733824:12345-192.168.204.27@tcp:501: Request processed in 1915us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850955.339026:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:3.0:1788850955.341446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850955.341654:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733952 00000100:00100000:1.0:1788850955.341663:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733952 00000100:00100000:1.0:1788850955.341726:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:1.0:1788850955.341736:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6178:x1875746000733952:12345-192.168.204.27@tcp:503: 00000100:00100000:1.0:1788850955.341883:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6178:x1875746000733952:12345-192.168.204.27@tcp:503: Request processed in 148us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850955.341891:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:3.0:1788850955.346938:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850955.347047:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734080 00000100:00100000:0.0:1788850955.347058:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734080 00000100:00100000:0.0:1788850955.347123:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:0.0:1788850955.347134:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6200:x1875746000734080:12345-192.168.204.27@tcp:502: 00000100:00100000:0.0:1788850955.347311:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6200:x1875746000734080:12345-192.168.204.27@tcp:502: Request processed in 177us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850955.347319:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:2.0:1788850955.350631:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850955.350725:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734208 00000100:00100000:3.0:1788850955.350741:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734208 00000100:00100000:3.0:1788850955.350804:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:3.0:1788850955.350813:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6200:x1875746000734208:12345-192.168.204.27@tcp:502: 00000100:00100000:3.0:1788850955.352167:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6200:x1875746000734208:12345-192.168.204.27@tcp:502: Request processed in 1348us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850955.352178:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:2.0:1788850955.362675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850955.362857:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734336 00000100:00100000:0.0:1788850955.362868:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734336 00000100:00100000:0.0:1788850955.365518:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:0.0:1788850955.365787:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1875746000734336:12345-192.168.204.27@tcp:38: 00010000:00080000:0.0:1788850955.365828:0:6535:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:0.0:1788850955.365886:0:6535:0:(genops.c:1384:class_connect()) connect: client a99889d1-fa00-4984-a18e-0736ff414641, cookie 0x3e0030720b205913 00000004:00100000:0.0:1788850955.365925:0:6535:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788850955.366175:0:6535:0:(import.c:65:import_set_state_nolock()) ffff892ea55ff800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788850955.366594:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2406:x1875746000734336:12345-192.168.204.27@tcp:38: Request processed in 811us (3928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850955.366604:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1788850955.368555:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850955.372874:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734592 00000100:00100000:3.0:1788850955.372888:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734592 00000100:00100000:3.0:1788850955.372952:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1788850955.372961:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1875746000734592:12345-192.168.204.27@tcp:38: 00010000:00080000:3.0:1788850955.372995:0:9543:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:3.0:1788850955.373067:0:9543:0:(genops.c:1384:class_connect()) connect: client a99889d1-fa00-4984-a18e-0736ff414641, cookie 0x3e0030720b20591a 00000004:00100000:3.0:1788850955.373090:0:9543:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788850955.373563:0:9543:0:(import.c:65:import_set_state_nolock()) ffff892d879de800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850955.373840:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2406:x1875746000734592:12345-192.168.204.27@tcp:38: Request processed in 877us (11117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850955.373849:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00010000:00010000:0.0:1788850955.444245:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850956.373538:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850956.373594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850956.374030:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734848 00000100:00100000:2.0:1788850956.374043:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734848 00000100:00100000:2.0:1788850956.374114:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734720 00000100:00100000:2.0:1788850956.374118:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734720 00000100:00100000:2.0:1788850956.374145:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1788850956.374154:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:6178:x1875746000734848:12345-192.168.204.27@tcp:41: 00000004:00000024:2.0:1788850956.374193:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:3.0:1788850956.374293:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788850956.374294:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:6178:x1875746000734848:12345-192.168.204.27@tcp:41: Request processed in 139us (764us total) trans 0 rc 0/0 00000100:00080000:3.0:1788850956.374299:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850956.374306:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1788850956.374319:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1788850956.374330:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:0:x1875746000734720:12345-192.168.204.27@tcp:41: 00000004:00000024:3.0:1788850956.374352:0:9543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788850956.374381:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:0:x1875746000734720:12345-192.168.204.27@tcp:41: Request processed in 53us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850956.374387:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:1.0:1788850956.380599:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850956.380712:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734464 00000100:00100000:2.0:1788850956.380723:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734464 00000100:00100000:2.0:1788850956.380796:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:2.0:1788850956.380806:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:0:x1875746000734464:12345-192.168.204.27@tcp:41: 00000004:00000024:2.0:1788850956.380837:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788850956.380917:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:0:x1875746000734464:12345-192.168.204.27@tcp:41: Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850956.380925:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:1.0:1788850956.385122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850956.385234:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734976 00000100:00100000:0.0:1788850956.385243:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734976 00000100:00100000:0.0:1788850956.385297:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1788850956.385309:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:6178:x1875746000734976:12345-192.168.204.27@tcp:40: 00000100:00100000:0.0:1788850956.385406:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:6178:x1875746000734976:12345-192.168.204.27@tcp:40: Request processed in 99us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850956.385414:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1788850956.393853:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850956.393915:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850956.394041:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850956.394060:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735360 00000100:00100000:2.0:1788850956.394075:0:6546:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735360 00000100:00100000:2.0:1788850956.394162:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1788850956.394180:0:6546:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a99889d1-fa00-4984-a18e-0736ff414641+6:6178:x1875746000735360:12345-192.168.204.27@tcp:900: 00000100:00100000:2.0:1788850956.394304:0:6546:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a99889d1-fa00-4984-a18e-0736ff414641+6:6178:x1875746000735360:12345-192.168.204.27@tcp:900: Request processed in 128us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850956.394316:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1788850956.399834:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850956.399885:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850956.399928:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735616 00000100:00100000:0.0:1788850956.399937:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735616 00000100:00100000:0.0:1788850956.399987:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1788850956.399997:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:6178:x1875746000735616:12345-192.168.204.27@tcp:33: 00000100:00100000:2.0:1788850956.400290:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735488 00000100:00100000:2.0:1788850956.400296:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735488 00000100:00100000:2.0:1788850956.400342:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:2.0:1788850956.400350:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000735488:12345-192.168.204.27@tcp:400: 00000100:00100000:2.0:1788850956.400414:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000735488:12345-192.168.204.27@tcp:400: Request processed in 64us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850956.400421:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:1.0:1788850956.403130:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735104 00000100:00100000:1.0:1788850956.403143:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735104 00000100:00100000:1.0:1788850956.403188:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735232 00000100:00100000:1.0:1788850956.403191:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735232 00000100:00100000:1.0:1788850956.403287:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1788850956.403324:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875746000735104:12345-192.168.204.27@tcp:8: 00010000:00080000:1.0:1788850956.403355:0:8450:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:1.0:1788850956.403385:0:8450:0:(genops.c:1384:class_connect()) connect: client a99889d1-fa00-4984-a18e-0736ff414641, cookie 0x3e0030720b205921 00002000:00100000:1.0:1788850956.403396:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a99889d1-fa00-4984-a18e-0736ff414641/ffff892d876b9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788850956.403414:0:8450:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788850956.403608:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788850956.403658:0:8450:0:(import.c:65:import_set_state_nolock()) ffff892d876be800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788850956.403732:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2406:x1875746000735104:12345-192.168.204.27@tcp:8: Request processed in 409us (9816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850956.403741:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1788850956.403759:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:1.0:1788850956.403763:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875746000735232:12345-192.168.204.27@tcp:8: 00010000:00080000:1.0:1788850956.403781:0:8450:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:1.0:1788850956.403798:0:8450:0:(genops.c:1384:class_connect()) connect: client a99889d1-fa00-4984-a18e-0736ff414641, cookie 0x3e0030720b205928 00002000:00100000:1.0:1788850956.403803:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a99889d1-fa00-4984-a18e-0736ff414641/ffff892d876bd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788850956.403813:0:8450:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788850956.403917:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788850956.403946:0:8450:0:(import.c:65:import_set_state_nolock()) ffff892d876bf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788850956.403970:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2406:x1875746000735232:12345-192.168.204.27@tcp:8: Request processed in 205us (9959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850956.403976:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000004:00080000:0.0:1788850956.439436:0:6537:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39309us 00000004:00200000:2.0:1788850956.456473:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788850956.456678:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:6178:x1875746000735616:12345-192.168.204.27@tcp:33: Request processed in 56676us (56785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850956.456695:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00010000:00010000:0.0:1788850956.468290:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850956.689151:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850956.689361:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735744 00000100:00100000:2.0:1788850956.689372:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735744 00000100:00100000:2.0:1788850956.689430:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1788850956.689439:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:6218:x1875746000735744:12345-192.168.204.27@tcp:101: 00010000:00010000:2.0:1788850956.689457:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850956.689530:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20592f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38940 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850956.689607:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205936 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850956.689651:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850956.689666:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788850956.689714:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788850956.689718:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788850956.689733:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850956.689758:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20592f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38940 expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850956.689776:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38940 expref: 7 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850956.689784:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea55ec600) 00010000:00010000:2.0:1788850956.689787:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788850956.689790:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7c00, rc 0) 00000100:00100000:2.0:1788850956.689851:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:6218:x1875746000735744:12345-192.168.204.27@tcp:101: Request processed in 412us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850956.689857:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1788850957.236402:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850957.236443:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019657728:0@lo:41: 00000100:00100000:2.0:1788850957.236513:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850957.237195:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657728 00000100:00100000:0.0:1788850957.237205:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657728 00000100:00100000:0.0:1788850957.237283:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788850957.237294:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019657728:12345-0@lo:41: 00000004:00000024:0.0:1788850957.237520:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788850957.237667:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019657728:12345-0@lo:41: Request processed in 374us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850957.237674:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788850957.241625:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019657728:0@lo:41: 00010000:00010000:0.0:1788850957.496907:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850958.517768:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850959.051201:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850959.051602:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735872 00000100:00100000:2.0:1788850959.051638:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735872 00000100:00100000:2.0:1788850959.051714:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:2.0:1788850959.051734:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:6271:x1875746000735872:12345-192.168.204.27@tcp:41: 00000004:00000024:2.0:1788850959.051775:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788850959.051850:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:6271:x1875746000735872:12345-192.168.204.27@tcp:41: Request processed in 127us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.051858:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00080000:3.0:1788850959.052501:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850959.055666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850959.056081:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736000 00000100:00100000:2.0:1788850959.056094:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736000 00000100:00100000:2.0:1788850959.056179:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:2.0:1788850959.056189:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:6271:x1875746000736000:12345-192.168.204.27@tcp:41: 00000004:00000024:2.0:1788850959.056229:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788850959.056307:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:6271:x1875746000736000:12345-192.168.204.27@tcp:41: Request processed in 118us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.056315:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:3.0:1788850959.056775:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788850959.061447:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850959.061676:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736128 00000100:00100000:2.0:1788850959.061687:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736128 00000100:00100000:2.0:1788850959.061763:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1788850959.061773:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a99889d1-fa00-4984-a18e-0736ff414641+6:6271:x1875746000736128:12345-192.168.204.27@tcp:13: 00002000:00000024:2.0:1788850959.061812:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850959.061946:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a99889d1-fa00-4984-a18e-0736ff414641+6:6271:x1875746000736128:12345-192.168.204.27@tcp:13: Request processed in 174us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.065525:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00080000:3.0:1788850959.065722:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788850959.070607:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850959.070752:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736256 00000100:00100000:2.0:1788850959.070765:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736256 00000100:00100000:2.0:1788850959.070839:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1788850959.070850:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a99889d1-fa00-4984-a18e-0736ff414641+6:6271:x1875746000736256:12345-192.168.204.27@tcp:13: 00002000:00000024:2.0:1788850959.070898:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850959.070988:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a99889d1-fa00-4984-a18e-0736ff414641+6:6271:x1875746000736256:12345-192.168.204.27@tcp:13: Request processed in 140us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.070997:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00080000:3.0:1788850959.074254:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788850959.285091:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019657856:0@lo:13: 00000100:00100000:3.0:1788850959.285168:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850959.285288:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657856 00000100:00100000:1.0:1788850959.285312:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657856 00000100:00100000:1.0:1788850959.285375:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788850959.285385:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019657856:12345-0@lo:13: 00002000:00000024:1.0:1788850959.285408:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850959.285454:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019657856:12345-0@lo:13: Request processed in 71us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850959.285462:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788850959.285531:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788850959.285572:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c67480 x1875746019657856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850959.285592:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019657856:0@lo:13: 00000100:00100000:0.0:1788850959.285868:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019657984:0@lo:13: 00000100:00100000:0.0:1788850959.285901:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850959.285982:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657984 00000100:00100000:3.0:1788850959.285986:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657984 00000100:00100000:3.0:1788850959.286038:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788850959.286045:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019657984:12345-0@lo:13: 00002000:00000024:3.0:1788850959.286055:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850959.286085:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019657984:12345-0@lo:13: Request processed in 42us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850959.286098:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788850959.286125:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e16d80 x1875746019657984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850959.286138:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019657984:0@lo:13: 00000100:00100000:2.0:1788850959.286353:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019658496:0@lo:400: 00000100:00100000:2.0:1788850959.286384:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.286404:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019659008:0@lo:400: 00000100:00100000:2.0:1788850959.286427:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.286443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019659520:0@lo:400: 00000100:00100000:2.0:1788850959.286463:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.286487:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788850959.286492:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019658368:0@lo:400: 00000100:00100000:2.0:1788850959.286598:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.286617:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019658880:0@lo:400: 00000100:00100000:2.0:1788850959.286635:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.286651:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019659392:0@lo:400: 00000100:00100000:2.0:1788850959.286670:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.286696:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659520 00000100:00100000:2.0:1788850959.286700:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659520 00000100:00100000:2.0:1788850959.286735:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788850959.286742:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019659520:12345-0@lo:400: 00000100:00100000:2.0:1788850959.286776:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019659520:12345-0@lo:400: Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.286782:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788850959.286804:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659008 00000100:00100000:2.0:1788850959.286814:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659008 00000100:00100000:2.0:1788850959.286835:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658368 00000100:00100000:2.0:1788850959.286838:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658368 00000100:00100000:2.0:1788850959.286848:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658880 00000100:00100000:2.0:1788850959.286850:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658880 00000100:00100000:2.0:1788850959.286861:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659392 00000100:00100000:2.0:1788850959.286863:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659392 00000100:00100000:2.0:1788850959.286877:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788850959.286882:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019659008:12345-0@lo:400: 00000100:00100000:2.0:1788850959.286912:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019659008:12345-0@lo:400: Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.286917:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788850959.286928:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788850959.286934:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019658368:12345-0@lo:400: 00000100:00100000:2.0:1788850959.286960:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019658368:12345-0@lo:400: Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.286966:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788850959.286976:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788850959.286982:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019658880:12345-0@lo:400: 00000100:00100000:2.0:1788850959.287007:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019658880:12345-0@lo:400: Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.287038:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788850959.287052:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788850959.287058:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019659392:12345-0@lo:400: 00000100:00100000:2.0:1788850959.287085:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019659392:12345-0@lo:400: Request processed in 29us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.287091:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788850959.287106:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658496 00000100:00100000:2.0:1788850959.287115:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658496 00000100:00100000:2.0:1788850959.287137:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788850959.287142:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019658496:12345-0@lo:400: 00000100:00100000:2.0:1788850959.287173:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019658496:12345-0@lo:400: Request processed in 30us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.287179:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788850959.287206:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019658112:0@lo:13: 00000100:00100000:2.0:1788850959.287231:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.287253:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019658624:0@lo:400: 00000100:00100000:2.0:1788850959.287272:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.287287:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019659136:0@lo:400: 00000100:00100000:2.0:1788850959.287306:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.287322:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788850959.287328:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019658240:0@lo:400: 00000100:00100000:2.0:1788850959.287353:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.287373:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019658752:0@lo:400: 00000100:00100000:2.0:1788850959.287392:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.287407:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019659264:0@lo:400: 00000100:00100000:2.0:1788850959.287424:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850959.287443:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658752 00000100:00100000:2.0:1788850959.287447:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658752 00000100:00100000:2.0:1788850959.287465:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788850959.287470:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019658752:12345-0@lo:400: 00000100:00100000:0.0:1788850959.288043:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658240 00000100:00100000:0.0:1788850959.288049:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658240 00000100:00100000:0.0:1788850959.288088:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788850959.288096:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019658240:12345-0@lo:400: 00000100:00100000:0.0:1788850959.288141:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019658240:12345-0@lo:400: Request processed in 46us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850959.288148:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1788850959.288180:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788850959.288185:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788850959.288188:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850959.288212:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019658240:0@lo:400: 00000100:00100000:0.0:1788850959.288271:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019658368:0@lo:400: 00000100:00100000:0.0:1788850959.288283:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019658880:0@lo:400: 00010000:00080000:0.0:1788850959.288295:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea591dc00 x1875746019659392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850959.288319:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019659392:0@lo:400: 00000100:00100000:0.0:1788850959.288333:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019658496:0@lo:400: 00010000:00080000:0.0:1788850959.288350:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea591f800 x1875746019659008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850959.288357:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019659008:0@lo:400: 00010000:00080000:0.0:1788850959.288366:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea591e680 x1875746019659520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850959.288374:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019659520:0@lo:400: 00000100:00100000:0.0:1788850959.288404:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658624 00000100:00100000:0.0:1788850959.288408:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658624 00000100:00100000:0.0:1788850959.288429:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659264 00000100:00100000:0.0:1788850959.288431:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659264 00000100:00100000:0.0:1788850959.288453:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788850959.288459:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019658624:12345-0@lo:400: 00000100:00100000:0.0:1788850959.288493:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019658624:12345-0@lo:400: Request processed in 34us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850959.288499:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788850959.288523:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788850959.288531:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019659264:12345-0@lo:400: 00000100:00100000:0.0:1788850959.288556:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019659264:12345-0@lo:400: Request processed in 26us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850959.288562:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788850959.288586:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850959.288605:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019659264:0@lo:400: 00000100:00100000:0.0:1788850959.288628:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019658624:0@lo:400: 00000100:00100000:3.0:1788850959.288943:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658112 00000100:00100000:3.0:1788850959.288948:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658112 00000100:00100000:3.0:1788850959.288980:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788850959.288987:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019658112:12345-0@lo:13: 00002000:00000024:3.0:1788850959.289007:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850959.289064:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019658112:12345-0@lo:13: Request processed in 78us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850959.289070:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788850959.289090:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659136 00000100:00100000:3.0:1788850959.289094:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659136 00000100:00100000:3.0:1788850959.289122:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788850959.289128:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019659136:12345-0@lo:400: 00000100:00100000:3.0:1788850959.289155:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019659136:12345-0@lo:400: Request processed in 27us (1848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850959.289160:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788850959.289172:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788850959.289221:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788850959.289233:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019659648:0@lo:13: 00000100:00100000:1.0:1788850959.289269:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850959.289343:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659648 00000100:00100000:3.0:1788850959.289347:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659648 00000100:00100000:3.0:1788850959.289374:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788850959.289380:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019659648:12345-0@lo:13: 00002000:00000024:3.0:1788850959.289391:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850959.289422:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019659648:12345-0@lo:13: Request processed in 42us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850959.289435:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788850959.289463:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e16d80 x1875746019659648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850959.289480:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019659648:0@lo:13: 00000100:00100000:2.0:1788850959.289700:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019658752:12345-0@lo:400: Request processed in 2228us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850959.289710:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788850959.290661:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019658752:0@lo:400: 00010000:00080000:0.0:1788850959.290679:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9ad80 x1875746019658112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850959.290695:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019658112:0@lo:13: 00010000:00080000:0.0:1788850959.290729:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea591d500 x1875746019659136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850959.290739:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019659136:0@lo:400: 00010000:00010000:0.0:1788850959.541722:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788850959.809105:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000100:00100000:3.0:1788850960.310275:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019659776:0@lo:41: 00000100:00100000:3.0:1788850960.310356:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850960.310442:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659776 00000100:00100000:3.0:1788850960.310450:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659776 00000100:00100000:3.0:1788850960.310501:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788850960.310510:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019659776:12345-0@lo:41: 00000004:00000024:3.0:1788850960.310557:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788850960.310607:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019659776:12345-0@lo:41: Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850960.310614:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788850960.310655:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019659776:0@lo:41: 00010000:00010000:0.0:1788850960.565048:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788850960.824490:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000001:00100000:3.0:1788850960.827256:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00010000:00010000:0.0:1788850961.588255:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850961.651340:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850961.651389:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850961.651418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850961.651441:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850961.651470:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850961.651505:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736512 00000100:00100000:3.0:1788850961.651516:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736512 00000100:00100000:3.0:1788850961.651594:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736640 00000100:00100000:3.0:1788850961.651598:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736640 00000100:00100000:1.0:1788850961.651626:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736384 00000100:00100000:3.0:1788850961.651629:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:1.0:1788850961.651631:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736384 00000100:00100000:3.0:1788850961.651655:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000736512:12345-192.168.204.27@tcp:400: 00000100:00100000:1.0:1788850961.651677:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:1.0:1788850961.651685:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000736384:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1788850961.651736:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000736512:12345-192.168.204.27@tcp:400: Request processed in 79us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850961.651744:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1788850961.651761:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:3.0:1788850961.651768:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000736640:12345-192.168.204.27@tcp:400: 00000100:00100000:2.0:1788850961.651928:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736768 00000100:00100000:2.0:1788850961.651934:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736768 00000100:00100000:2.0:1788850961.651967:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736896 00000100:00100000:2.0:1788850961.651971:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736896 00000100:00100000:2.0:1788850961.651992:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:2.0:1788850961.651999:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000736768:12345-192.168.204.27@tcp:400: 00000100:00100000:1.0:1788850961.660179:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000736384:12345-192.168.204.27@tcp:400: Request processed in 8479us (8833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850961.660197:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:3.0:1788850961.668080:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000736640:12345-192.168.204.27@tcp:400: Request processed in 16298us (16647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850961.668098:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00080000:3.0:1788850961.668139:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788850961.668144:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788850961.668148:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788850961.668150:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850961.668210:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1788850961.668225:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000736896:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1788850961.668297:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000736896:12345-192.168.204.27@tcp:400: Request processed in 78us (16825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850961.668303:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:2.0:1788850961.669088:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000736768:12345-192.168.204.27@tcp:400: Request processed in 17085us (17641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850961.669099:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000001:02000400:2.0:1788850961.783985:0:10198:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788850961.855822:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000100:00100000:1.0:1788850962.356389:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019659904:0@lo:41: 00000100:00100000:1.0:1788850962.356463:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850962.356679:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659904 00000100:00100000:3.0:1788850962.356687:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659904 00000100:00100000:3.0:1788850962.356747:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788850962.356757:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019659904:12345-0@lo:41: 00000004:00000024:3.0:1788850962.356788:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788850962.356848:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019659904:12345-0@lo:41: Request processed in 94us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850962.356855:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788850962.357064:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019659904:0@lo:41: 00010000:00010000:1.0:1788850962.612137:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850963.636182:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850964.405707:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019660032:0@lo:13: 00000100:00100000:1.0:1788850964.405786:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850964.406114:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788850964.406125:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019660160:0@lo:13: 00000100:00100000:3.0:1788850964.406156:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850964.406278:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660032 00000100:00100000:1.0:1788850964.406285:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660032 00000100:00100000:1.0:1788850964.406342:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660160 00000100:00100000:1.0:1788850964.406346:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660160 00000100:00100000:1.0:1788850964.406362:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788850964.406371:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019660032:12345-0@lo:13: 00002000:00000024:1.0:1788850964.406412:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850964.406454:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019660032:12345-0@lo:13: Request processed in 84us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850964.406461:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788850964.406500:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788850964.406507:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019660160:12345-0@lo:13: 00002000:00000024:1.0:1788850964.406524:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850964.406552:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019660160:12345-0@lo:13: Request processed in 46us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850964.406558:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788850964.406576:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788850964.406581:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788850964.406590:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019660416:0@lo:13: 00000100:00100000:1.0:1788850964.406616:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788850964.406660:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea591d500 x1875746019660032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850964.406679:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019660032:0@lo:13: 00000100:00100000:1.0:1788850964.406699:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660416 00000100:00100000:1.0:1788850964.406702:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660416 00000100:00100000:1.0:1788850964.406725:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788850964.406732:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019660416:12345-0@lo:13: 00002000:00000024:1.0:1788850964.406740:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850964.406767:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019660416:12345-0@lo:13: Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850964.406780:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788850964.406795:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788850964.406811:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c67b80 x1875746019660416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850964.406824:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019660416:0@lo:13: 00000100:00100000:3.0:1788850964.407003:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019660288:0@lo:13: 00000100:00100000:3.0:1788850964.407056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788850964.407083:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c55c00 x1875746019660160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850964.407097:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019660160:0@lo:13: 00000100:00100000:2.0:1788850964.407361:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660288 00000100:00100000:2.0:1788850964.407366:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660288 00000100:00100000:2.0:1788850964.407390:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788850964.407405:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019660288:12345-0@lo:13: 00002000:00000024:2.0:1788850964.407416:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850964.407449:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019660288:12345-0@lo:13: Request processed in 45us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850964.407455:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788850964.408587:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850964.408911:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019660672:0@lo:400: 00000100:00100000:0.0:1788850964.408974:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850964.409003:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019661184:0@lo:400: 00000100:00100000:0.0:1788850964.409050:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850964.409073:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788850964.409078:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019660800:0@lo:400: 00000100:00100000:0.0:1788850964.409102:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850964.409121:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019661312:0@lo:400: 00000100:00100000:0.0:1788850964.409143:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850964.409170:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660672 00000100:00100000:0.0:1788850964.409176:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660672 00000100:00100000:0.0:1788850964.409229:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661184 00000100:00100000:0.0:1788850964.409233:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661184 00000100:00100000:0.0:1788850964.409250:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661312 00000100:00100000:0.0:1788850964.409253:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661312 00000100:00100000:0.0:1788850964.409267:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788850964.409274:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019660672:12345-0@lo:400: 00000100:00100000:0.0:1788850964.409321:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019660672:12345-0@lo:400: Request processed in 47us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850964.409327:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788850964.409343:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788850964.409350:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019661184:12345-0@lo:400: 00000100:00100000:0.0:1788850964.409374:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019661184:12345-0@lo:400: Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850964.409379:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788850964.409390:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788850964.409487:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019661312:12345-0@lo:400: 00000100:00100000:0.0:1788850964.409585:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019661312:12345-0@lo:400: Request processed in 189us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850964.409592:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788850964.409616:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660800 00000100:00100000:0.0:1788850964.409620:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660800 00000100:00100000:2.0:1788850964.409751:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019660928:0@lo:400: 00000100:00100000:2.0:1788850964.409782:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850964.409802:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019661440:0@lo:400: 00000100:00100000:2.0:1788850964.409821:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850964.409838:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788850964.409844:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019660544:0@lo:400: 00000100:00100000:2.0:1788850964.409870:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850964.409895:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019661056:0@lo:400: 00000100:00100000:2.0:1788850964.409929:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850964.409944:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019661568:0@lo:400: 00000100:00100000:2.0:1788850964.409960:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850964.409998:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788850964.410009:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019660800:12345-0@lo:400: 00000100:00100000:0.0:1788850964.410070:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019660800:12345-0@lo:400: Request processed in 64us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850964.410076:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788850964.410089:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661056 00000100:00100000:0.0:1788850964.410098:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661056 00000100:00100000:0.0:1788850964.410115:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788850964.410120:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019661056:12345-0@lo:400: 00000100:00100000:0.0:1788850964.410159:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019661056:12345-0@lo:400: Request processed in 38us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850964.410164:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788850964.410181:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660928 00000100:00100000:0.0:1788850964.410184:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660928 00000100:00100000:0.0:1788850964.410199:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661440 00000100:00100000:0.0:1788850964.410202:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661440 00000100:00100000:0.0:1788850964.410214:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661568 00000100:00100000:0.0:1788850964.410216:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661568 00000100:00100000:0.0:1788850964.410228:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788850964.410233:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019660928:12345-0@lo:400: 00000100:00100000:0.0:1788850964.410260:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019660928:12345-0@lo:400: Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850964.410265:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788850964.410276:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788850964.410282:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019661440:12345-0@lo:400: 00000100:00100000:0.0:1788850964.410305:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019661440:12345-0@lo:400: Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850964.410310:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788850964.410321:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788850964.410326:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019661568:12345-0@lo:400: 00000100:00100000:0.0:1788850964.410350:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019661568:12345-0@lo:400: Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850964.410356:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788850964.410379:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660544 00000100:00100000:0.0:1788850964.410390:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660544 00000100:00080000:1.0:1788850964.410947:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788850964.410952:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788850964.411093:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019660800:0@lo:400: 00010000:00080000:1.0:1788850964.411115:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c36d80 x1875746019661312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850964.411125:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019661312:0@lo:400: 00000100:00100000:1.0:1788850964.411139:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019660672:0@lo:400: 00000100:00100000:1.0:1788850964.411150:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019661184:0@lo:400: 00000100:00100000:0.0:1788850964.411631:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788850964.411643:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019660544:12345-0@lo:400: 00000100:00100000:2.0:1788850964.411771:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019661056:0@lo:400: 00010000:00080000:2.0:1788850964.411782:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c37480 x1875746019661568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850964.411790:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019661568:0@lo:400: 00000100:00100000:2.0:1788850964.411799:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019660928:0@lo:400: 00000100:00100000:2.0:1788850964.411807:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019661440:0@lo:400: 00010000:00080000:2.0:1788850964.412081:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c66300 x1875746019660288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850964.412099:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019660288:0@lo:13: 00000100:00100000:0.0:1788850964.412226:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019660544:12345-0@lo:400: Request processed in 587us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850964.412233:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788850964.412361:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019660544:0@lo:400: 00010000:00010000:1.0:1788850964.660270:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850965.428222:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019661696:0@lo:41: 00000100:00100000:2.0:1788850965.428294:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850965.428418:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661696 00000100:00100000:3.0:1788850965.428427:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661696 00000100:00100000:3.0:1788850965.428495:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788850965.428505:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019661696:12345-0@lo:41: 00000004:00000024:3.0:1788850965.428537:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788850965.428585:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019661696:12345-0@lo:41: Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850965.428593:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788850965.428801:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019661696:0@lo:41: 00000020:00000080:3.0:1788850965.592999:0:10346:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccb3728a0 20000000:00000080:3.0:1788850965.593103:0:10346:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892d87b6ac00 uarg=0000000000000000 20000000:01000000:3.0:1788850965.593148:0:10346:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788850965.593151:0:10346:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788850965.593153:0:10346:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788850965.593158:0:10346:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788850965.593164:0:10346:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788850965.593229:0:10346:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788850965.593232:0:10346:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788850965.593896:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788850965.594591:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788850965.594693:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788850965.594713:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788850965.594732:0:10346:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788850965.594735:0:10346:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788850965.595708:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788850965.596000:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788850965.596172:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788850965.596189:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788850965.596200:0:10346:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788850965.596202:0:10346:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788850965.596961:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788850965.597294:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788850965.597317:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788850965.597331:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788850965.597350:0:10346:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788850965.597352:0:10346:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788850965.597914:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788850965.598199:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788850965.598220:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788850965.598235:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788850965.598245:0:10346:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788850965.598247:0:10346:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788850965.598746:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788850965.598979:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788850965.598998:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788850965.599131:0:10346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:2.0:1788850965.599148:0:10346:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788850965.599170:0:10346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599191:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2057d1 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599200:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2057fb expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599207:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20583a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599214:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205848 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599222:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205856 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599229:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205872 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599237:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20589c expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599254:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2058b8 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599263:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2058e2 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599273:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d0 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599281:0:10346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d7 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599289:0:10346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599329:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d7 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599348:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d7 expref: 9 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.599363:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019661824:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788850965.599737:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d0 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599747:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d0 expref: 9 pid: 6526 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.599757:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019661952:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788850965.599808:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2058e2 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.599817:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2058e2 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.599898:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662080:0@lo:104: 00000100:00100000:2.0:1788850965.599941:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850965.600052:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2058b8 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.600061:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2058b8 expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.600070:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662208:0@lo:104: 00000100:00100000:2.0:1788850965.600091:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850965.604319:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b20589c expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.604342:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b20589c expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.604358:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662336:0@lo:104: 00000100:00100000:2.0:1788850965.604436:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850965.604956:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662080 00000100:00100000:3.0:1788850965.604964:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662080 00000100:00100000:0.0:1788850965.605109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662208 00000100:00100000:0.0:1788850965.605115:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662208 00000100:00100000:3.0:1788850965.605207:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788850965.605219:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:10346:x1875746019662080:12345-0@lo:104: 00010000:00010000:3.0:1788850965.605238:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850965.605316:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788850965.605322:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:10346:x1875746019662080:12345-0@lo:104: Request processed in 106us (5381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850965.605328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788850965.605594:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850965.606062:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850965.606109:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788850965.606117:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:10346:x1875746019662208:12345-0@lo:104: 00010000:00010000:1.0:1788850965.606129:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606172:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788850965.606177:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:10346:x1875746019662208:12345-0@lo:104: Request processed in 61us (6086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.606196:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788850965.606214:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788850965.606219:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606227:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95c00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788850965.606232:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606241:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850965.606248:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850965.606254:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850965.606284:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606290:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788850965.606311:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606319:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b2058e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2058e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606333:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788850965.606336:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606354:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433dc00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788850965.606357:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606363:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850965.606370:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850965.606374:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850965.606389:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606395:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788850965.606411:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606418:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b2058b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2058bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.606428:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850965.606430:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850965.606431:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850965.606456:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019662464:0@lo:103: 00000100:00100000:1.0:1788850965.606491:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850965.607002:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850965.607042:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019662592:0@lo:103: 00000100:00100000:0.0:1788850965.607076:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850965.607108:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737024 00000100:00100000:0.0:1788850965.607114:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737024 00010000:00010000:0.0:1788850965.607141:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d7 expref: 10 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850965.607158:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737152 00000100:00100000:0.0:1788850965.607161:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737152 00010000:00010000:0.0:1788850965.607171:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d0 expref: 11 pid: 6526 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850965.607181:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662464 00000100:00100000:0.0:1788850965.607183:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662464 00010000:00010000:0.0:1788850965.607193:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2058e2 expref: 24 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850965.607217:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662592 00000100:00100000:0.0:1788850965.607219:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662592 00010000:00010000:0.0:1788850965.607230:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2058b8 expref: 25 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850965.607243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1788850965.607250:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:2410:x1875746000737024:12345-192.168.204.27@tcp:103: 00010000:00010000:0.0:1788850965.607261:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850965.607266:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d7 expref: 11 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.607278:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d7 expref: 11 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.607300:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850965.607341:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:2410:x1875746000737024:12345-192.168.204.27@tcp:103: Request processed in 90us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850965.607348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1788850965.607388:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1788850965.607394:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2410:x1875746000737152:12345-192.168.204.27@tcp:103: 00010000:00010000:0.0:1788850965.607402:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850965.607407:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d0 expref: 10 pid: 6526 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.607417:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d0 expref: 10 pid: 6526 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.607437:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850965.607471:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2410:x1875746000737152:12345-192.168.204.27@tcp:103: Request processed in 76us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850965.607478:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1788850965.607490:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788850965.607496:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3648:x1875746019662464:12345-0@lo:103: 00010000:00010000:0.0:1788850965.607503:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850965.607507:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2058e2 expref: 25 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.607964:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2058e2 expref: 25 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.607976:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850965.608042:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3648:x1875746019662464:12345-0@lo:103: Request processed in 546us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850965.608049:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788850965.608063:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788850965.608069:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019662592:12345-0@lo:103: 00010000:00010000:0.0:1788850965.608077:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850965.608081:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2058b8 expref: 24 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.608089:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2058b8 expref: 24 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.608098:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850965.608131:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019662592:12345-0@lo:103: Request processed in 63us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850965.608138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788850965.608488:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019662592:0@lo:103: 00000100:00100000:1.0:1788850965.608596:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019662464:0@lo:103: 00010000:00010000:2.0:1788850965.609067:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205872 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.609080:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205872 expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.609105:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662720:0@lo:104: 00000100:00100000:2.0:1788850965.609147:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850965.609720:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205856 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.609731:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205856 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.609740:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662848:0@lo:104: 00010000:00010000:2.0:1788850965.609764:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205848 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.609772:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205848 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.609780:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662976:0@lo:104: 00010000:00010000:2.0:1788850965.609800:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b20583a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.609807:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b20583a expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.609815:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019663104:0@lo:104: 00010000:00010000:2.0:1788850965.609844:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2057fb expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.609851:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2057fb expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.609871:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019663232:0@lo:104: 00010000:00010000:2.0:1788850965.609892:0:10346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2057d1 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.609900:0:10346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2057d1 expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.609907:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019663360:0@lo:104: 00000100:00100000:2.0:1788850965.609921:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9240 going to sleep for 11 seconds 00010000:00010000:2.0:1788850965.609938:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433c000/0x3e0030720b2058fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d7 expref: 9 pid: 6528 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.609951:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019661824:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788850965.609965:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6400/0x3e0030720b2058f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c388d0 expref: 8 pid: 6526 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.609973:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019661952:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788850965.609982:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff95000/0x3e0030720b2058e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2058e2 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.609989:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662080:0@lo:104: 00010000:00010000:2.0:1788850965.609997:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433c200/0x3e0030720b2058bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2058b8 expref: 22 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.610005:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662208:0@lo:104: 00000100:00100000:1.0:1788850965.610216:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788850965.610238:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850965.610249:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850965.610257:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850965.610264:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850965.610271:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850965.610278:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662336 00000100:00100000:1.0:1788850965.610284:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662336 00000100:00100000:1.0:1788850965.610316:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662720 00000100:00100000:1.0:1788850965.610318:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662720 00000100:00100000:1.0:1788850965.610325:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662848 00000100:00100000:1.0:1788850965.610327:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662848 00000100:00100000:1.0:1788850965.610333:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662976 00000100:00100000:1.0:1788850965.610335:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662976 00000100:00100000:1.0:1788850965.610343:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663104 00000100:00100000:1.0:1788850965.610345:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663104 00000100:00100000:1.0:1788850965.610351:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663232 00000100:00100000:1.0:1788850965.610353:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663232 00000100:00100000:1.0:1788850965.610360:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663360 00000100:00100000:1.0:1788850965.610362:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663360 00000100:00100000:1.0:1788850965.610372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788850965.610379:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:10346:x1875746019662336:12345-0@lo:104: 00010000:00010000:1.0:1788850965.610391:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.610459:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788850965.610465:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+9:10346:x1875746019662336:12345-0@lo:104: Request processed in 86us (6029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.610470:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788850965.610485:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788850965.610490:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+8:10346:x1875746019662720:12345-0@lo:104: 00010000:00010000:1.0:1788850965.610504:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.610544:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788850965.610549:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+8:10346:x1875746019662720:12345-0@lo:104: Request processed in 59us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.610555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788850965.610583:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788850965.610588:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+7:10346:x1875746019662848:12345-0@lo:104: 00010000:00010000:1.0:1788850965.610595:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.610626:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788850965.610631:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+7:10346:x1875746019662848:12345-0@lo:104: Request processed in 43us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.610636:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788850965.610645:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788850965.610650:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:10346:x1875746019662976:12345-0@lo:104: 00010000:00010000:1.0:1788850965.610656:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.610676:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788850965.610680:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:10346:x1875746019662976:12345-0@lo:104: Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.610685:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788850965.610693:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788850965.610697:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:10346:x1875746019663104:12345-0@lo:104: 00010000:00010000:1.0:1788850965.610709:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.610729:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788850965.610734:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:10346:x1875746019663104:12345-0@lo:104: Request processed in 36us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.610739:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788850965.610748:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788850965.610753:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:10346:x1875746019663232:12345-0@lo:104: 00010000:00010000:1.0:1788850965.610759:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.610796:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788850965.610800:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:10346:x1875746019663232:12345-0@lo:104: Request processed in 48us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.610806:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788850965.610817:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788850965.610822:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:10346:x1875746019663360:12345-0@lo:104: 00010000:00010000:0.0:1788850965.610908:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788850965.610915:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.610922:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850965.610927:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.610935:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850965.610943:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850965.610949:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850965.610980:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.610986:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850965.611002:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611009:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ea200/0x3e0030720b20589c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2058a3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611041:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788850965.611044:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611060:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eae00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850965.611063:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611070:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850965.611077:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850965.611081:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850965.611093:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611098:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850965.611109:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611116:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b205872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205879 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611125:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788850965.611127:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611133:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ebe00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850965.611135:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611151:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850965.611157:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850965.611162:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850965.611171:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611176:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850965.611180:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611187:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b205856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20585d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611196:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788850965.611198:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611204:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94a00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850965.611207:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611213:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850965.611219:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850965.611228:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850965.611237:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611242:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850965.611247:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611253:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff94a00/0x3e0030720b205848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20584f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611260:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788850965.611263:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611268:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2155a00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850965.611270:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611276:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850965.611283:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850965.611288:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850965.611296:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611301:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850965.611308:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611315:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ec2155a00/0x3e0030720b20583a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205841 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611323:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850965.611325:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611331:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433da00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850965.611334:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611340:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850965.611346:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850965.611351:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850965.611359:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611364:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850965.611367:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611373:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433da00/0x3e0030720b2057fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205802 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611380:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850965.611385:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850965.611387:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850965.611400:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019663616:0@lo:103: 00000100:00100000:0.0:1788850965.611433:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850965.611497:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019664128:0@lo:103: 00000100:00100000:0.0:1788850965.611515:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850965.611532:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788850965.611536:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019663744:0@lo:103: 00000100:00100000:0.0:1788850965.611552:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850965.611573:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663616 00000100:00100000:0.0:1788850965.611578:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663616 00010000:00010000:0.0:1788850965.611601:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205872 expref: 22 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850965.611619:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664128 00000100:00100000:0.0:1788850965.611621:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664128 00010000:00010000:0.0:1788850965.611629:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2057fb expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850965.611637:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663744 00000100:00100000:0.0:1788850965.611639:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663744 00010000:00010000:0.0:1788850965.611646:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205856 expref: 24 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850965.611656:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788850965.611661:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019663616:12345-0@lo:103: 00010000:00010000:0.0:1788850965.611670:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850965.611675:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205872 expref: 24 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611694:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205872 expref: 24 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611710:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850965.611734:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019663616:12345-0@lo:103: Request processed in 72us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850965.611741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788850965.611753:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788850965.611758:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3647:x1875746019664128:12345-0@lo:103: 00010000:00010000:0.0:1788850965.611764:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850965.611768:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2057fb expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611776:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2057fb expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611784:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850965.611800:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3647:x1875746019664128:12345-0@lo:103: Request processed in 43us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850965.611806:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788850965.611815:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788850965.611820:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:3647:x1875746019663744:12345-0@lo:103: 00010000:00010000:0.0:1788850965.611826:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850965.611842:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205856 expref: 22 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611850:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205856 expref: 22 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.611863:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850965.611881:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:3647:x1875746019663744:12345-0@lo:103: Request processed in 61us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850965.611887:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788850965.611913:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019663744:0@lo:103: 00000100:00100000:0.0:1788850965.611920:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019663616:0@lo:103: 00000100:00100000:0.0:1788850965.611925:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019664128:0@lo:103: 00010000:00010000:1.0:1788850965.612462:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.612526:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788850965.612533:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:10346:x1875746019663360:12345-0@lo:104: Request processed in 1711us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.612540:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788850965.612565:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788850965.612571:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.612591:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eb600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788850965.612596:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.612605:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850965.612622:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850965.612628:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850965.612650:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.612657:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788850965.612673:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.612680:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b2057d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2057d8 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.612697:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850965.612698:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850965.612700:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850965.612714:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019663488:0@lo:103: 00000100:00100000:1.0:1788850965.612746:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850965.612765:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019664000:0@lo:103: 00000100:00100000:1.0:1788850965.612784:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850965.612805:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850965.612811:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019663872:0@lo:103: 00000100:00100000:1.0:1788850965.612831:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850965.613016:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788850965.613042:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019664256:0@lo:103: 00000100:00100000:1.0:1788850965.613065:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850965.613086:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663488 00000100:00100000:1.0:1788850965.613092:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663488 00010000:00010000:1.0:1788850965.613112:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20589c expref: 22 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850965.613127:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664000 00000100:00100000:1.0:1788850965.613129:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664000 00010000:00010000:1.0:1788850965.613138:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20583a expref: 23 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850965.613147:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663872 00000100:00100000:1.0:1788850965.613150:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663872 00010000:00010000:1.0:1788850965.613160:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205848 expref: 24 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850965.613169:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664256 00000100:00100000:1.0:1788850965.613171:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664256 00010000:00010000:1.0:1788850965.613180:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2057d1 expref: 25 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850965.613192:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788850965.613198:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3650:x1875746019663488:12345-0@lo:103: 00010000:00010000:1.0:1788850965.613206:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850965.613211:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20589c expref: 25 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.613388:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b20589c expref: 25 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.613403:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850965.613433:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3650:x1875746019663488:12345-0@lo:103: Request processed in 236us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.613450:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788850965.613486:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788850965.613491:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019664000:12345-0@lo:103: 00010000:00010000:1.0:1788850965.613499:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850965.613503:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20583a expref: 24 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850965.613616:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850965.613728:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b20583a expref: 24 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.613739:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850965.613765:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019664000:12345-0@lo:103: Request processed in 274us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.613772:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788850965.613786:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788850965.613792:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3650:x1875746019663872:12345-0@lo:103: 00010000:00010000:1.0:1788850965.613800:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850965.613804:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205848 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.613812:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205848 expref: 23 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.613902:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850965.613927:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3650:x1875746019663872:12345-0@lo:103: Request processed in 135us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.613934:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788850965.613946:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788850965.613952:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:3647:x1875746019664256:12345-0@lo:103: 00010000:00010000:1.0:1788850965.613959:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850965.613964:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2057d1 expref: 22 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.613974:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2057d1 expref: 22 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.613985:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.613993:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.614008:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.614075:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.614081:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.614088:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.614100:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788850965.614105:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.614113:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.614122:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850965.614132:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850965.614207:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:3647:x1875746019664256:12345-0@lo:103: Request processed in 255us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850965.614214:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788850965.614260:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019663872:0@lo:103: 00000100:00100000:1.0:1788850965.614270:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019663488:0@lo:103: 00000100:00100000:1.0:1788850965.614277:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019664000:0@lo:103: 00010000:00010000:2.0:1788850965.614472:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e7200/0x3e0030720b2058a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b20589c expref: 21 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.614492:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662336:0@lo:104: 00010000:00010000:2.0:1788850965.614505:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2155e00/0x3e0030720b205879 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205872 expref: 20 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.614524:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662720:0@lo:104: 00010000:00010000:2.0:1788850965.614535:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827ea600/0x3e0030720b20585d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205856 expref: 19 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.614543:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662848:0@lo:104: 00010000:00010000:2.0:1788850965.614552:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2154e00/0x3e0030720b20584f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205848 expref: 18 pid: 6529 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.614562:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019662976:0@lo:104: 00010000:00010000:2.0:1788850965.614572:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433ce00/0x3e0030720b205841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b20583a expref: 17 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.614579:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019663104:0@lo:104: 00010000:00010000:2.0:1788850965.614588:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94600/0x3e0030720b205802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2057fb expref: 16 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.614606:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019663232:0@lo:104: 00010000:00010000:2.0:1788850965.614621:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433ca00/0x3e0030720b2057d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2057d1 expref: 15 pid: 6526 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850965.614629:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10346:1875746019663360:0@lo:104: 00010000:00010000:2.0:1788850965.614659:0:10346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.614675:0:10346:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.614681:0:10346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850965.614688:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e7e00/0x3e0030720b20593d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850965.617118:0:6518:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1788850965.619788:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019664256:0@lo:103: 00010000:00010000:1.0:1788850965.685089:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850966.709381:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850966.788068:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850966.788116:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850966.788147:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850966.788185:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850966.788209:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850966.788228:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737792 00000100:00100000:2.0:1788850966.788239:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737792 00000100:00100000:2.0:1788850966.788309:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737664 00000100:00100000:2.0:1788850966.788313:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737664 00000100:00100000:0.0:1788850966.788316:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737536 00000100:00100000:0.0:1788850966.788320:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737536 00000100:00100000:2.0:1788850966.788338:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1788850966.788358:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737408 00000100:00100000:0.0:1788850966.788361:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737408 00000100:00100000:0.0:1788850966.788386:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1788850966.788397:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000737536:12345-192.168.204.27@tcp:400: 00000100:00100000:0.0:1788850966.788490:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000737536:12345-192.168.204.27@tcp:400: Request processed in 94us (373us total) trans 0 rc 0/0 00000100:00080000:1.0:1788850966.788501:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788850966.788505:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788850966.788507:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00080000:1.0:1788850966.788508:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788850966.788510:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850966.788523:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1788850966.788539:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000737408:12345-192.168.204.27@tcp:400: 00000100:00100000:0.0:1788850966.788564:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000737408:12345-192.168.204.27@tcp:400: Request processed in 27us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850966.788570:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1788850966.788639:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000737792:12345-192.168.204.27@tcp:400: 00000100:00100000:2.0:1788850966.788667:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000737792:12345-192.168.204.27@tcp:400: Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850966.789745:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737280 00000100:00100000:3.0:1788850966.789757:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737280 00000100:00100000:3.0:1788850966.789857:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 200 00000100:00100000:3.0:1788850966.789867:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:2410:x1875746000737280:12345-192.168.204.27@tcp:400: 00000100:00100000:3.0:1788850966.789924:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:2410:x1875746000737280:12345-192.168.204.27@tcp:400: Request processed in 59us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850966.789932:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 200 00000100:00100000:0.0:1788850966.794268:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1788850966.794299:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000737664:12345-192.168.204.27@tcp:400: 00000100:00100000:0.0:1788850966.794395:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000737664:12345-192.168.204.27@tcp:400: Request processed in 114us (6184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850966.794403:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:2.0:1788850966.796292:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 10000000:01000000:3.0:1788850967.156710:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788850967.156719:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ea7c1e800 from 48 10000000:01000000:3.0:1788850967.156725:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788850967.156780:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.156794:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.156827:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850967.156853:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019664384:0@lo:101: 00000100:00100000:3.0:1788850967.156927:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.157032:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab000 going to sleep for 11 seconds 00000100:00100000:0.0:1788850967.157116:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664384 00000100:00100000:0.0:1788850967.157125:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664384 00000100:00100000:0.0:1788850967.157183:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788850967.157193:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+15:6531:x1875746019664384:12345-0@lo:101: 00010000:00010000:0.0:1788850967.157208:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850967.157222:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433da00/0x3e0030720b20594b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205944 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.157246:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433da00/0x3e0030720b20594b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205944 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.157258:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433da00/0x3e0030720b20594b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205944 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.157267:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433da00, rc 0) 00000100:00100000:0.0:1788850967.157313:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019664384:12345-0@lo:101: Request processed in 122us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850967.157320:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788850967.157474:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019664384:0@lo:101: 00010000:00010000:1.0:1788850967.157490:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.157500:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850967.157580:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019664512:0@lo:501: 00000100:00100000:1.0:1788850967.157609:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.157638:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850967.157758:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664512 00000100:00100000:0.0:1788850967.157763:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664512 00000100:00100000:0.0:1788850967.157803:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788850967.157811:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019664512:12345-0@lo:501: 00000100:00100000:0.0:1788850967.157943:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019664512:12345-0@lo:501: Request processed in 132us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850967.157960:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788850967.158703:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019664512:0@lo:501: 00000100:00100000:1.0:1788850967.158759:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019664640:0@lo:503: 00000100:00100000:1.0:1788850967.158806:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.158839:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.158901:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664640 00000100:00100000:3.0:1788850967.158907:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664640 00000100:00100000:3.0:1788850967.158948:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788850967.158957:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019664640:12345-0@lo:503: 00000100:00100000:3.0:1788850967.159075:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019664640:12345-0@lo:503: Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.159082:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788850967.159621:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019664640:0@lo:503: 00000100:00100000:1.0:1788850967.159954:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10363:1875746019664768:0@lo:502: 00000100:00100000:1.0:1788850967.160003:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.160098:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.163128:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664768 00000100:00100000:2.0:1788850967.163145:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664768 00000100:00100000:2.0:1788850967.163373:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788850967.163387:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:10363:x1875746019664768:12345-0@lo:502: 00000100:00100000:2.0:1788850967.163870:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:10363:x1875746019664768:12345-0@lo:502: Request processed in 486us (3865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.163878:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788850967.163988:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10363:1875746019664768:0@lo:502: 00000100:00100000:1.0:1788850967.164080:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10363:1875746019664896:0@lo:502: 00000100:00100000:1.0:1788850967.164125:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.174352:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.175124:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664896 00000100:00100000:2.0:1788850967.175136:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664896 00000100:00100000:2.0:1788850967.175207:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788850967.175217:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:10363:x1875746019664896:12345-0@lo:502: 00000100:00100000:2.0:1788850967.175387:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:10363:x1875746019664896:12345-0@lo:502: Request processed in 171us (11260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.175396:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788850967.179130:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10363:1875746019664896:0@lo:502: 00000040:00080000:1.0:1788850967.179193:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788850967.179420:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788850967.179444:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788850967.179455:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.179468:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850967.179479:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788850967.179482:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788850967.179484:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788850967.179532:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.179541:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.179550:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850967.179570:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665024:0@lo:101: 00000100:00100000:2.0:1788850967.179626:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.179668:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.179772:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665024 00000100:00100000:1.0:1788850967.179790:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665024 00000100:00100000:1.0:1788850967.179827:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788850967.179835:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+16:6531:x1875746019665024:12345-0@lo:101: 00010000:00010000:1.0:1788850967.179848:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850967.179859:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff95400/0x3e0030720b205959 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205952 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.179883:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff95400/0x3e0030720b205959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205952 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.179893:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff95400/0x3e0030720b205959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205952 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.179902:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95400, rc 0) 00000100:00100000:1.0:1788850967.179947:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019665024:12345-0@lo:101: Request processed in 113us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.179954:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788850967.180579:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665024:0@lo:101: 00010000:00010000:2.0:1788850967.180607:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.180617:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850967.180674:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665152:0@lo:501: 00000100:00100000:2.0:1788850967.180708:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.180740:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.180862:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665152 00000100:00100000:1.0:1788850967.180868:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665152 00000100:00100000:1.0:1788850967.180891:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788850967.180897:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019665152:12345-0@lo:501: 00000100:00100000:1.0:1788850967.181061:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019665152:12345-0@lo:501: Request processed in 163us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.181068:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788850967.181625:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665152:0@lo:501: 00000100:00100000:2.0:1788850967.181660:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665280:0@lo:503: 00000100:00100000:2.0:1788850967.181710:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.181740:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.181790:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665280 00000100:00100000:1.0:1788850967.181795:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665280 00000100:00100000:1.0:1788850967.181814:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788850967.181821:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019665280:12345-0@lo:503: 00000100:00100000:1.0:1788850967.181916:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019665280:12345-0@lo:503: Request processed in 94us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.181928:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788850967.182002:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665280:0@lo:503: 00000100:00100000:2.0:1788850967.183075:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10364:1875746019665408:0@lo:502: 00000100:00100000:2.0:1788850967.183134:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.183168:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.183239:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665408 00000100:00100000:1.0:1788850967.183245:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665408 00000100:00100000:1.0:1788850967.183275:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788850967.183283:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:10364:x1875746019665408:12345-0@lo:502: 00000100:00100000:1.0:1788850967.183381:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:10364:x1875746019665408:12345-0@lo:502: Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.183389:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788850967.184142:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10364:1875746019665408:0@lo:502: 00000020:01000000:2.0:1788850967.184174:0:10364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850967.184184:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850967.184186:0:10364:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788850967.184191:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788850967.184215:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10364:1875746019665536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850967.184258:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.184288:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.184335:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665536 00000100:00100000:1.0:1788850967.184340:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665536 00000100:00100000:1.0:1788850967.184374:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788850967.184380:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:10364:x1875746019665536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.184479:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:10364:x1875746019665536:12345-0@lo:502:llog_process_th.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.184486:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788850967.185667:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10364:1875746019665536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850967.185717:0:10364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850967.185726:0:10364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850967.185729:0:10364:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788850967.185733:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788850967.187732:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788850967.187770:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788850967.187783:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.187796:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850967.187808:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788850967.187811:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ea5900800 from 48 10000000:01000000:1.0:1788850967.187814:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788850967.187855:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.187878:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.187890:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850967.187916:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.187985:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.188071:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.188133:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665664 00000100:00100000:2.0:1788850967.188142:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665664 00000100:00100000:2.0:1788850967.188194:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788850967.188203:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+17:6531:x1875746019665664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850967.188216:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850967.188230:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6400/0x3e0030720b205967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205960 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.188255:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6400/0x3e0030720b205967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205960 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.188266:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6400/0x3e0030720b205967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205960 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.188274:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6400, rc 0) 00000100:00100000:2.0:1788850967.188317:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019665664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.188324:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788850967.188618:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788850967.188632:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.188641:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850967.188696:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.188719:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.188739:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.188775:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665792 00000100:00100000:2.0:1788850967.188779:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665792 00000100:00100000:2.0:1788850967.188804:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788850967.188810:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019665792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.188920:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019665792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.188940:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788850967.189004:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.189056:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.189096:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.189111:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.189162:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665920 00000100:00100000:2.0:1788850967.189166:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665920 00000100:00100000:2.0:1788850967.189181:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788850967.189186:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019665920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.189269:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019665920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.189276:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788850967.189353:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019665920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.191886:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10365:1875746019666048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.191963:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.192009:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab000 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.192134:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666048 00000100:00100000:2.0:1788850967.192142:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666048 00000100:00100000:2.0:1788850967.192185:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788850967.192193:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:10365:x1875746019666048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850967.192325:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:10365:x1875746019666048:12345-0@lo:502:llog_process_th.0 Request processed in 131us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.192334:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788850967.192511:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10365:1875746019666048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.192631:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10365:1875746019666176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.192673:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.192699:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab000 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.192740:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666176 00000100:00100000:2.0:1788850967.192744:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666176 00000100:00100000:2.0:1788850967.192770:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788850967.192776:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:10365:x1875746019666176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850967.192845:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:10365:x1875746019666176:12345-0@lo:502:llog_process_th.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.192851:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788850967.192941:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10365:1875746019666176:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788850967.192961:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788850967.193612:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788850967.193640:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788850967.193650:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.193669:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850967.193680:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788850967.193682:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788850967.193685:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788850967.193712:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.193720:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.193730:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850967.193745:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019666304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.193784:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.194266:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788850967.200759:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666304 00000100:00100000:0.0:1788850967.200774:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666304 00000100:00100000:0.0:1788850967.200875:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788850967.200886:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+18:6531:x1875746019666304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788850967.200905:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850967.200923:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433c800/0x3e0030720b205975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20596e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.200953:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433c800/0x3e0030720b205975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20596e expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.200964:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433c800/0x3e0030720b205975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20596e expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.200973:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433c800, rc 0) 00000100:00100000:0.0:1788850967.201220:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019666304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 335us (7433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850967.201227:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788850967.207191:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019666304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850967.207225:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.207242:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850967.207335:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019666432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.207399:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.207456:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab000 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.207515:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666432 00000100:00100000:1.0:1788850967.207534:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666432 00000100:00100000:1.0:1788850967.207589:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788850967.207600:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019666432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.207759:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019666432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.207767:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788850967.207962:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019666432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.207992:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019666560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.208066:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.208084:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab000 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.208164:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666560 00000100:00100000:1.0:1788850967.208168:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666560 00000100:00100000:1.0:1788850967.208197:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788850967.208203:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019666560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.208301:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019666560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.208308:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788850967.208400:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019666560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.208802:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10366:1875746019666688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.208847:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.208882:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.208926:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666688 00000100:00100000:1.0:1788850967.208931:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666688 00000100:00100000:1.0:1788850967.208961:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788850967.208968:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:10366:x1875746019666688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.209090:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:10366:x1875746019666688:12345-0@lo:502:llog_process_th.0 Request processed in 121us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.209097:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788850967.209229:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10366:1875746019666688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788850967.209253:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788850967.209267:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788850967.209270:0:10366:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788850967.209276:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788850967.209296:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10366:1875746019666816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.209330:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.209358:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.209698:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666816 00000100:00100000:1.0:1788850967.209703:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666816 00000100:00100000:1.0:1788850967.209742:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788850967.209750:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:10366:x1875746019666816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.209835:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:10366:x1875746019666816:12345-0@lo:502:llog_process_th.0 Request processed in 86us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.209842:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788850967.209914:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10366:1875746019666816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788850967.209934:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788850967.209939:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788850967.209940:0:10366:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788850967.209944:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788850967.210184:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788850967.210205:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788850967.210213:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.210224:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850967.210243:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788850967.210245:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ebbbf6000 from 48 10000000:01000000:1.0:1788850967.210248:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788850967.210273:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.210282:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.210291:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850967.210306:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019666944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.210340:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.210374:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.210428:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666944 00000100:00100000:3.0:1788850967.210433:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666944 00000100:00100000:3.0:1788850967.210465:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788850967.210472:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:6531:x1875746019666944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850967.210482:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850967.210494:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eebbc00/0x3e0030720b205983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20597c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.210515:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebbc00/0x3e0030720b205983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20597c expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.210535:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eebbc00/0x3e0030720b205983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20597c expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.210544:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebbc00, rc 0) 00000100:00100000:3.0:1788850967.210581:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019666944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.210587:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788850967.210737:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019666944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788850967.210750:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.210758:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850967.210803:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.210827:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.210850:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.211134:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667072 00000100:00100000:3.0:1788850967.211139:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667072 00000100:00100000:3.0:1788850967.211172:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788850967.211179:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019667072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.211794:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019667072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 614us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.211803:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788850967.214670:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.214745:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.214841:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.217693:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.218193:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667200 00000100:00100000:2.0:1788850967.218203:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667200 00000100:00100000:2.0:1788850967.218298:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788850967.218309:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019667200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.218487:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019667200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.218496:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788850967.219768:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.220364:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10367:1875746019667328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.220449:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.228716:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667328 00000100:00100000:3.0:1788850967.228732:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667328 00000100:00100000:3.0:1788850967.228791:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788850967.228802:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:10367:x1875746019667328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.228999:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:10367:x1875746019667328:12345-0@lo:502:llog_process_th.0 Request processed in 198us (8548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.229007:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788850967.229145:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.229174:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10367:1875746019667328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.229240:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10367:1875746019667456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.229283:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.229310:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.232457:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667456 00000100:00100000:3.0:1788850967.232473:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667456 00000100:00100000:3.0:1788850967.232588:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788850967.232599:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:10367:x1875746019667456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.232833:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:10367:x1875746019667456:12345-0@lo:502:llog_process_th.0 Request processed in 236us (3549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.232841:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788850967.236247:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10367:1875746019667456:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788850967.236310:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788850967.236510:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788850967.236545:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788850967.236574:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.236588:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850967.236599:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788850967.236602:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788850967.236605:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788850967.236642:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.236651:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.236661:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850967.236685:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.236756:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.236803:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.236923:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667584 00000100:00100000:3.0:1788850967.236930:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667584 00000100:00100000:3.0:1788850967.236983:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788850967.236992:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019667584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850967.237005:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850967.237103:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eeba200/0x3e0030720b205991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20598a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.237127:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eeba200/0x3e0030720b205991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20598a expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.237138:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eeba200/0x3e0030720b205991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20598a expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.237146:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eeba200, rc 0) 00000100:00100000:3.0:1788850967.237184:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019667584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.237191:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788850967.237284:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850967.237298:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.237307:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850967.237360:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.237391:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.237423:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.237464:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667712 00000100:00100000:3.0:1788850967.237469:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667712 00000100:00100000:3.0:1788850967.237495:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788850967.237502:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019667712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.237618:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019667712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.237625:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788850967.237793:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.237824:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.237868:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.237895:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.237937:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667840 00000100:00100000:3.0:1788850967.237941:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667840 00000100:00100000:3.0:1788850967.237969:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788850967.237975:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019667840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.238089:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019667840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.238095:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788850967.238169:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019667840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.238494:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10368:1875746019667968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.238616:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.238647:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.238689:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667968 00000100:00100000:3.0:1788850967.238701:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667968 00000100:00100000:3.0:1788850967.238722:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788850967.238729:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:10368:x1875746019667968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.238820:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:10368:x1875746019667968:12345-0@lo:502:llog_process_th.0 Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.238826:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788850967.239713:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10368:1875746019667968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788850967.239747:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850967.239758:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850967.239761:0:10368:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788850967.239767:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788850967.239793:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10368:1875746019668096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.239842:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.239890:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf540 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.239937:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668096 00000100:00100000:3.0:1788850967.239943:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668096 00000100:00100000:3.0:1788850967.239971:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788850967.239979:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:10368:x1875746019668096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.240099:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:10368:x1875746019668096:12345-0@lo:502:llog_process_th.0 Request processed in 120us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.240106:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788850967.240634:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10368:1875746019668096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788850967.240656:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850967.240662:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850967.240664:0:10368:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788850967.240668:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1788850967.240824:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1788850967.240847:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788850967.240856:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.240866:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850967.240876:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788850967.240879:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892e91596800 from 48 10000000:01000000:3.0:1788850967.240882:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788850967.240907:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.240915:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.240932:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850967.240946:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.240983:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.241044:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.241155:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668224 00000100:00100000:1.0:1788850967.241160:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668224 00000100:00100000:1.0:1788850967.241195:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788850967.241203:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019668224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788850967.241215:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850967.241227:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff95600/0x3e0030720b20599f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205998 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.241248:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff95600/0x3e0030720b20599f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205998 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.241258:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff95600/0x3e0030720b20599f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205998 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850967.241266:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95600, rc 0) 00000100:00100000:1.0:1788850967.241298:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019668224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.241303:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788850967.241407:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850967.241431:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.241439:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850967.241488:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.241513:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.241621:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850967.242102:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668352 00000100:00100000:1.0:1788850967.242108:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668352 00000100:00100000:1.0:1788850967.242179:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788850967.242187:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019668352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.242313:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019668352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850967.242330:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788850967.242465:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.242496:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.242550:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.246764:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.250695:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668480 00000100:00100000:2.0:1788850967.250714:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668480 00000100:00100000:2.0:1788850967.250779:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788850967.250790:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019668480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.251698:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019668480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 907us (9143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.251708:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788850967.251861:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850967.252689:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10369:1875746019668608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.252754:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.252796:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf840 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.253094:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668608 00000100:00100000:3.0:1788850967.253101:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668608 00000100:00100000:3.0:1788850967.253140:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788850967.253149:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:10369:x1875746019668608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.253280:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:10369:x1875746019668608:12345-0@lo:502:llog_process_th.0 Request processed in 133us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.253288:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788850967.253680:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10369:1875746019668608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.253735:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10369:1875746019668736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850967.253775:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850967.253793:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.253878:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668736 00000100:00100000:2.0:1788850967.253883:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668736 00000100:00100000:2.0:1788850967.253915:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788850967.253923:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:10369:x1875746019668736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850967.254129:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:10369:x1875746019668736:12345-0@lo:502:llog_process_th.0 Request processed in 207us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.254137:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788850967.255071:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10369:1875746019668736:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788850967.255109:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788850967.255816:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788850967.255840:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788850967.255850:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.255861:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850967.255871:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788850967.255873:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788850967.255877:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788850967.255911:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.255920:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.255929:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850967.255947:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.255998:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.256063:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.257496:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668864 00000100:00100000:2.0:1788850967.257509:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668864 00000100:00100000:2.0:1788850967.257655:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788850967.257666:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019668864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850967.257682:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850967.257715:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6a00/0x3e0030720b2059ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2059a6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.257743:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6a00/0x3e0030720b2059ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2059a6 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.257754:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6a00/0x3e0030720b2059ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2059a6 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.257763:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6a00, rc 0) 00000100:00100000:2.0:1788850967.257835:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019668864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.257842:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788850967.258677:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850967.258698:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850967.258719:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850967.258793:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.258832:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.258868:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788850967.259875:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668992 00000100:00100000:0.0:1788850967.259885:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668992 00000100:00100000:0.0:1788850967.259927:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788850967.259935:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019668992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850967.260122:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019668992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850967.260130:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788850967.260429:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019668992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.260469:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019669120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.260597:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850967.260633:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788850967.260689:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669120 00000100:00100000:0.0:1788850967.260702:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669120 00000100:00100000:0.0:1788850967.260738:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788850967.260746:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019669120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788850967.260852:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019669120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850967.260859:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788850967.260941:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019669120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850967.261706:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10370:1875746019669248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850967.261759:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.261796:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e852c1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.261843:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669248 00000100:00100000:3.0:1788850967.261849:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669248 00000100:00100000:3.0:1788850967.261888:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788850967.261895:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:10370:x1875746019669248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850967.262038:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:10370:x1875746019669248:12345-0@lo:502:llog_process_th.0 Request processed in 143us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850967.262045:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788850967.262230:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10370:1875746019669248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850967.262257:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850967.262266:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850967.262268:0:10370:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788850967.262274:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788850967.262294:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10370:1875746019669376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850967.262329:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850967.262358:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788850967.262407:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669376 00000100:00100000:0.0:1788850967.262421:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669376 00000100:00100000:0.0:1788850967.262453:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788850967.262460:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:10370:x1875746019669376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850967.262602:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:10370:x1875746019669376:12345-0@lo:502:llog_process_th.0 Request processed in 141us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850967.262609:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788850967.262777:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10370:1875746019669376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850967.262796:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850967.262805:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850967.262807:0:10370:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788850967.262810:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788850967.263675:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788850967.263704:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788850967.263715:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.263728:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850967.263740:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788850967.263743:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff892ebbbc99c0 from 1 10000000:01000000:0.0:1788850967.263746:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788850967.263778:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.263788:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.263807:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850967.263825:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019669504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788850967.263865:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850967.263901:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850967.264049:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669504 00000100:00100000:2.0:1788850967.264056:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669504 00000100:00100000:2.0:1788850967.264090:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788850967.264097:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019669504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850967.264108:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850967.264122:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e7800/0x3e0030720b2059bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2059b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.264148:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e7800/0x3e0030720b2059bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2059b4 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.264160:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e7800/0x3e0030720b2059bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2059b4 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850967.264170:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7800, rc 0) 00000100:00100000:2.0:1788850967.264205:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019669504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850967.264213:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788850967.265167:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019669504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788850967.265187:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059bb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.265198:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2059bb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850967.265272:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019669632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850967.265313:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850967.265351:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850967.265421:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669632 00000100:00100000:3.0:1788850967.265427:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669632 00000100:00100000:3.0:1788850967.265466:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788850967.265474:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019669632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850967.265627:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019669632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (313us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788850967.265635:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788850967.266051:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019669632:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788850967.266081:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788850967.266088:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059bb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850967.266097:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059bb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850967.477934:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019669760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788850967.478046:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850967.478289:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669760 00000100:00100000:0.0:1788850967.478297:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669760 00000100:00100000:0.0:1788850967.478369:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788850967.478379:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019669760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788850967.478429:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788850967.478492:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019669760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850967.478500:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788850967.479323:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019669760:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788850967.732261:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850968.756267:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850969.524342:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019670144:0@lo:400:kworker.0 00000100:00100000:3.0:1788850969.524359:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019670400:0@lo:400:kworker.0 00000100:00100000:1.0:1788850969.524727:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019670272:0@lo:400:kworker.0 00000100:00100000:0.0:1788850969.524802:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019669888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788850969.529180:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850969.529262:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019670912:0@lo:400:kworker.0 00000100:00100000:3.0:1788850969.529307:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850969.529329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850969.529349:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019671424:0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.529382:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019670656:0@lo:400:kworker.0 00000100:00100000:3.0:1788850969.529391:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850969.529422:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850969.529448:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019671168:0@lo:400:kworker.0 00000100:00100000:3.0:1788850969.529457:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670400 00000100:00100000:3.0:1788850969.529466:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670400 00000100:00100000:3.0:1788850969.529525:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670144 00000100:00100000:3.0:1788850969.529529:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670144 00000100:00100000:3.0:1788850969.529545:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670656 00000100:00100000:3.0:1788850969.529547:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670656 00000100:00100000:2.0:1788850969.529656:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850969.529680:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019671680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850969.529826:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850969.530009:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850969.530039:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019671808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788850969.530295:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850969.530380:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670912 00000100:00100000:2.0:1788850969.530384:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670912 00000100:00100000:2.0:1788850969.530413:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671424 00000100:00100000:2.0:1788850969.530416:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671424 00000100:00100000:2.0:1788850969.530435:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788850969.530444:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019670912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.530697:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019670912:12345-0@lo:400:kworker.0 Request processed in 253us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850969.530705:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788850969.530722:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788850969.530781:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019671424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.530813:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019671424:12345-0@lo:400:kworker.0 Request processed in 35us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850969.530819:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788850969.530839:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671168 00000100:00100000:3.0:1788850969.530887:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788850969.530899:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019670400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850969.530940:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019670400:12345-0@lo:400:kworker.0 Request processed in 45us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850969.530947:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788850969.530963:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788850969.530970:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019670144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850969.531008:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019670144:12345-0@lo:400:kworker.0 Request processed in 38us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850969.531028:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788850969.531040:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788850969.531047:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019670656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850969.531079:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019670656:12345-0@lo:400:kworker.0 Request processed in 32us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850969.531100:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788850969.531121:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671168 00000100:00080000:3.0:1788850969.531122:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788850969.531128:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788850969.531132:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850969.531152:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019671936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788850969.531165:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788850969.531174:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019671168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850969.531188:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850969.531237:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019671168:12345-0@lo:400:kworker.0 Request processed in 64us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850969.531238:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019670400:0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.531251:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1788850969.531261:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca1880 x1875746019670912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850969.531273:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019670912:0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.531276:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671680 00000100:00100000:2.0:1788850969.531283:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671680 00010000:00080000:3.0:1788850969.531287:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca2a00 x1875746019671424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850969.531298:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019671424:0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.531330:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671808 00000100:00100000:2.0:1788850969.531335:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671808 00000100:00100000:2.0:1788850969.531350:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671936 00000100:00100000:2.0:1788850969.531354:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671936 00000100:00100000:3.0:1788850969.531378:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788850969.531387:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019671680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788850969.531408:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850969.531441:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019671680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850969.531448:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788850969.531462:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788850969.531468:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019671808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788850969.531481:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850969.531506:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019671808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850969.533196:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788850969.533232:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788850969.533246:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019671936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788850969.533271:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850969.533360:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019671936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (2173us total) trans 0 rc 0/0 00000100:00080000:2.0:1788850969.533423:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850969.533429:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788850969.534124:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8748bb80 x1875746019671808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850969.534146:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019671808:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788850969.534160:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca2300 x1875746019671680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850969.534170:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019671680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850969.534184:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019670144:0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.534196:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019670656:0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.534206:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019671168:0@lo:400:kworker.0 00010000:00080000:2.0:1788850969.534260:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd4a80 x1875746019671936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850969.534272:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019671936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788850969.535140:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850969.535174:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019670784:0@lo:400:kworker.0 00000100:00100000:1.0:1788850969.535201:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850969.535221:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019671296:0@lo:400:kworker.0 00000100:00100000:1.0:1788850969.535240:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850969.535267:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670784 00000100:00100000:1.0:1788850969.535274:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670784 00000100:00100000:1.0:1788850969.535324:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671296 00000100:00100000:1.0:1788850969.535341:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671296 00000100:00100000:1.0:1788850969.535385:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788850969.535394:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019670784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850969.535454:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019670784:12345-0@lo:400:kworker.0 Request processed in 62us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850969.535461:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788850969.535488:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788850969.535495:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019671296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850969.535520:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019671296:12345-0@lo:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850969.535526:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788850969.535546:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788850969.535568:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca3100 x1875746019671296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850969.535579:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019671296:0@lo:400:kworker.0 00010000:00080000:1.0:1788850969.535601:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca2d80 x1875746019670784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850969.535609:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019670784:0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.535796:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670272 00000100:00100000:2.0:1788850969.535802:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670272 00000100:00100000:2.0:1788850969.535840:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788850969.535858:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019670272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.535902:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019670272:12345-0@lo:400:kworker.0 Request processed in 46us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850969.535923:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788850969.536754:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788850969.537649:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019670272:0@lo:400:kworker.0 00000100:00100000:0.0:1788850969.546142:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850969.546224:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019670016:0@lo:400:kworker.0 00000100:00100000:0.0:1788850969.546263:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850969.546301:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019670528:0@lo:400:kworker.0 00000100:00100000:0.0:1788850969.546326:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850969.546695:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670016 00000100:00100000:3.0:1788850969.546703:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670016 00000100:00100000:3.0:1788850969.546761:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788850969.546770:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019670016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850969.546825:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019670016:12345-0@lo:400:kworker.0 Request processed in 56us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850969.546833:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788850969.547755:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669888 00000100:00100000:2.0:1788850969.547762:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669888 00000100:00100000:2.0:1788850969.547811:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788850969.547819:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019669888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788850969.547837:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850969.547888:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019669888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850969.547894:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788850969.548060:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019671040:0@lo:400:kworker.0 00000100:00100000:0.0:1788850969.548094:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850969.548122:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019671552:0@lo:400:kworker.0 00000100:00100000:0.0:1788850969.548144:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788850969.548185:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ed80 x1875746019669888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850969.548204:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019669888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788850969.548215:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019670016:0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.548599:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671040 00000100:00100000:2.0:1788850969.548605:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671040 00000100:00100000:2.0:1788850969.548640:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671552 00000100:00100000:2.0:1788850969.548643:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671552 00000100:00100000:2.0:1788850969.548665:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788850969.548671:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019671040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.548713:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019671040:12345-0@lo:400:kworker.0 Request processed in 42us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850969.548720:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788850969.548734:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788850969.548740:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019671552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850969.548768:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019671552:12345-0@lo:400:kworker.0 Request processed in 29us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850969.548773:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788850969.549196:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca3480 x1875746019671040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850969.549207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019671040:0@lo:400:kworker.0 00010000:00080000:0.0:1788850969.549235:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca0000 x1875746019671552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850969.549244:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019671552:0@lo:400:kworker.0 00000100:00100000:1.0:1788850969.553540:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670528 00000100:00100000:1.0:1788850969.553558:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670528 00000100:00100000:1.0:1788850969.553635:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788850969.553646:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019670528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850969.553765:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019670528:12345-0@lo:400:kworker.0 Request processed in 122us (7437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850969.553793:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788850969.553882:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019670528:0@lo:400:kworker.0 00010000:00010000:1.0:1788850969.780945:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850970.548387:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019672064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788850970.548474:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850970.548693:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019672064 00000100:00100000:1.0:1788850970.548702:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019672064 00000100:00100000:1.0:1788850970.548756:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788850970.548765:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019672064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788850970.548800:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788850970.548856:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019672064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850970.548863:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788850970.548949:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019672064:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788850970.804471:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850970.873579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850970.873683:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737920 00000100:00100000:0.0:1788850970.873694:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737920 00000100:00100000:0.0:1788850970.873757:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:0.0:1788850970.873768:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:6192:x1875746000737920:12345-192.168.204.27@tcp:101: 00010000:00010000:0.0:1788850970.873785:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850970.873807:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433ca00/0x3e0030720b2059c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38947 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850970.873837:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433ca00/0x3e0030720b2059c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38947 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850970.873848:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433ca00/0x3e0030720b2059c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38947 expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850970.873857:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433ca00, rc 0) 00000100:00100000:0.0:1788850970.873917:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6192:x1875746000737920:12345-192.168.204.27@tcp:101: Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850970.873925:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:0.0:1788850970.884515:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850970.884626:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738048 00000100:00100000:3.0:1788850970.884638:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738048 00000100:00100000:3.0:1788850970.884703:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:3.0:1788850970.884714:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6192:x1875746000738048:12345-192.168.204.27@tcp:501: 00000100:00100000:3.0:1788850970.884884:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6192:x1875746000738048:12345-192.168.204.27@tcp:501: Request processed in 172us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850970.884892:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:1.0:1788850970.888235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850970.888573:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738176 00000100:00100000:3.0:1788850970.888585:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738176 00000100:00100000:3.0:1788850970.888698:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:3.0:1788850970.888707:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6192:x1875746000738176:12345-192.168.204.27@tcp:503: 00000100:00100000:3.0:1788850970.888865:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6192:x1875746000738176:12345-192.168.204.27@tcp:503: Request processed in 159us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850970.888872:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:1.0:1788850970.897634:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850970.899176:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738304 00000100:00100000:0.0:1788850970.899192:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738304 00000100:00100000:0.0:1788850970.899255:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:0.0:1788850970.899265:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6689:x1875746000738304:12345-192.168.204.27@tcp:502: 00000100:00100000:0.0:1788850970.899491:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6689:x1875746000738304:12345-192.168.204.27@tcp:502: Request processed in 226us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850970.899499:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:1.0:1788850970.902539:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850970.905932:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738432 00000100:00100000:3.0:1788850970.905950:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738432 00000100:00100000:3.0:1788850970.906224:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:2.0:1788850970.907511:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6689:x1875746000738432:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788850970.907706:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6689:x1875746000738432:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 1470us (5175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850970.914112:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850970.914441:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738560 00000100:00100000:0.0:1788850970.914452:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738560 00000100:00100000:0.0:1788850970.914495:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:0.0:1788850970.914505:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6192:x1875746000738560:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788850970.914522:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850970.914542:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433ce00/0x3e0030720b2059c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3894e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850970.914591:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433ce00/0x3e0030720b2059c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3894e expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850970.914604:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433ce00/0x3e0030720b2059c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3894e expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850970.914613:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433ce00, rc 0) 00000100:00100000:0.0:1788850970.914685:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:6192:x1875746000738560:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 181us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850970.914693:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:2.0:1788850970.915620:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:1.0:1788850970.917306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850970.917846:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738688 00000100:00100000:0.0:1788850970.917869:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738688 00000100:00100000:0.0:1788850970.917927:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:0.0:1788850970.917938:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6192:x1875746000738688:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850970.918105:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6192:x1875746000738688:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 168us (803us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788850970.918114:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 250 00010000:00010000:1.0:1788850971.828288:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850971.897601:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850971.897645:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850971.897681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850971.897707:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850971.897712:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738816 00000100:00100000:2.0:1788850971.897721:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738816 00000100:00100000:1.0:1788850971.897732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850971.897752:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739328 00000100:00100000:1.0:1788850971.897756:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739328 00000100:00100000:2.0:1788850971.897774:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:2.0:1788850971.897783:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2409:x1875746000738816:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788850971.897789:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739200 00000100:00100000:1.0:1788850971.897791:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739200 00000100:00100000:1.0:1788850971.897810:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788850971.897818:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000739328:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788850971.897852:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2409:x1875746000738816:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850971.897857:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000739328:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 42us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850971.897860:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:1.0:1788850971.897863:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788850971.897875:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1788850971.897880:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000739200:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788850971.897902:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000739200:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850971.897908:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1788850971.897926:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739072 00000100:00100000:1.0:1788850971.897930:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739072 00000100:00100000:1.0:1788850971.897967:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738944 00000100:00100000:1.0:1788850971.897970:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738944 00000100:00100000:1.0:1788850971.897993:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1788850971.897999:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000739072:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788850971.898052:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000739072:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 53us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850971.898059:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1788850971.898071:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:1.0:1788850971.898078:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000738944:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788850971.898102:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000738944:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850971.898109:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00080000:1.0:1788850971.898128:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788850971.898131:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788850971.898134:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788850971.898143:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1788850972.032860:0:10408:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa1120680 20000000:00000080:1.0:1788850972.032882:0:10408:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892d87bd9000 uarg=0000000000000000 20000000:01000000:1.0:1788850972.032931:0:10408:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788850972.032938:0:10408:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788850972.032942:0:10408:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788850972.034743:0:10409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788850972.037925:0:10408:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788850972.049799:0:10408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788850972.049837:0:10408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788850972.049853:0:10408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788850972.049868:0:10408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788850972.049890:0:10408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.049909:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e827ea800/0x3e0030720b20566c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205665 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.049917:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205673 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.049924:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2056c7 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.049932:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2057ed expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.049943:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3890f expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.049952:0:10408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.050005:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3890f expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.050669:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3890f expref: 9 pid: 6528 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.050685:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672192:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788850972.050844:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2057ed expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.050854:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2057ed expref: 23 pid: 6529 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.050864:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672320:0@lo:104: 00000100:00100000:2.0:1788850972.050907:0:10408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850972.050953:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2056c7 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.050961:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2056c7 expref: 23 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.050969:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672448:0@lo:104: 00000100:00100000:2.0:1788850972.050992:0:10408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850972.051037:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205673 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.051046:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205673 expref: 23 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.051069:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672576:0@lo:104: 00010000:00010000:2.0:1788850972.051101:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e827ea800/0x3e0030720b20566c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205665 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.051109:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e827ea800/0x3e0030720b20566c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205665 expref: 23 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.051117:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672704:0@lo:104: 00000100:00100000:2.0:1788850972.051135:0:10408:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850972.051215:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788850972.051234:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850972.051246:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850972.051267:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019672320 00000100:00100000:0.0:1788850972.051274:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019672320 00000100:00100000:0.0:1788850972.051312:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019672448 00000100:00100000:0.0:1788850972.051315:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019672448 00000100:00100000:0.0:1788850972.051338:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019672576 00000100:00100000:0.0:1788850972.051341:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019672576 00000100:00100000:0.0:1788850972.051350:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019672704 00000100:00100000:0.0:1788850972.051352:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019672704 00000100:00100000:0.0:1788850972.051364:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788850972.051372:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:10408:x1875746019672320:12345-0@lo:104: 00010000:00010000:0.0:1788850972.051384:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051443:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788850972.051450:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:10408:x1875746019672320:12345-0@lo:104: Request processed in 79us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850972.051457:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788850972.051475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788850972.051481:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5918450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:10408:x1875746019672448:12345-0@lo:104: 00010000:00010000:0.0:1788850972.051495:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051535:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788850972.051541:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5918450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:10408:x1875746019672448:12345-0@lo:104: Request processed in 61us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850972.051548:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788850972.051577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788850972.051583:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:10408:x1875746019672576:12345-0@lo:104: 00010000:00010000:0.0:1788850972.051591:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051615:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788850972.051620:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:10408:x1875746019672576:12345-0@lo:104: Request processed in 38us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850972.051626:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788850972.051636:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788850972.051642:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:10408:x1875746019672704:12345-0@lo:104: 00010000:00010000:0.0:1788850972.051649:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051673:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788850972.051678:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:10408:x1875746019672704:12345-0@lo:104: Request processed in 37us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850972.051683:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788850972.051700:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788850972.051706:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051719:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850972.051723:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051731:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850972.051739:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850972.051744:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788850972.051772:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051779:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850972.051798:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051806:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff94200/0x3e0030720b2057ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2057f4 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051819:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788850972.051822:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051828:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebac00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850972.051831:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051848:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850972.051855:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850972.051860:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788850972.051875:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051881:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850972.051888:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051895:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e9eebac00/0x3e0030720b2056c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2056ce expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051905:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788850972.051908:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051914:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850972.051918:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051925:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850972.051932:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850972.051943:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788850972.051956:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051962:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850972.051976:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051983:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b205673 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20567a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.051993:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850972.051996:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.052002:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eeba800 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788850972.052005:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.052054:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850972.052061:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850972.052065:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788850972.052078:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.052083:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850972.052096:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.052102:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e9eeba800/0x3e0030720b205665 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20566c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850972.052115:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850972.052117:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850972.052119:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850972.052140:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019673216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788850972.052171:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850972.052200:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788850972.052206:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019673088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788850972.052227:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850972.053094:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019672960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788850972.053134:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850972.053168:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788850972.053175:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019672832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788850972.053201:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850972.053224:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850972.054639:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673216 00000100:00100000:1.0:1788850972.054651:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673216 00010000:00010000:1.0:1788850972.054692:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e827ea800/0x3e0030720b20566c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205665 expref: 24 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850972.054715:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673088 00000100:00100000:1.0:1788850972.054718:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673088 00010000:00010000:1.0:1788850972.054728:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205673 expref: 25 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850972.054738:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019672960 00000100:00100000:1.0:1788850972.054740:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019672960 00010000:00010000:1.0:1788850972.054748:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2056c7 expref: 26 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850972.054756:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019672832 00000100:00100000:1.0:1788850972.054759:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019672832 00010000:00010000:1.0:1788850972.054767:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2057ed expref: 27 pid: 6529 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850972.054779:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788850972.054786:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+27:3650:x1875746019673216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788850972.054800:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850972.054806:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e827ea800/0x3e0030720b20566c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205665 expref: 27 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.054827:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e827ea800/0x3e0030720b20566c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205665 expref: 27 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.054847:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850972.054910:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+27:3650:x1875746019673216:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850972.054918:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788850972.054935:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788850972.054941:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+26:3650:x1875746019673088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788850972.054949:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850972.054953:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205673 expref: 26 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.054962:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205673 expref: 26 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.054971:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850972.054993:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+26:3650:x1875746019673088:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (2765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850972.054999:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788850972.055030:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788850972.055038:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3648:x1875746019672960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788850972.055046:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850972.055050:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2056c7 expref: 25 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.055057:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2056c7 expref: 25 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.055072:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850972.055106:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3648:x1875746019672960:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850972.055112:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788850972.055124:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788850972.055131:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019672832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788850972.055138:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850972.055142:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2057ed expref: 24 pid: 6529 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.055149:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2057ed expref: 24 pid: 6529 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.055159:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850972.055181:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019672832:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850972.055187:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1788850972.055416:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433d400/0x3e0030720b2057f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2057ed expref: 23 pid: 6529 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.055429:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672320:0@lo:104: 00010000:00010000:2.0:1788850972.055441:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031600/0x3e0030720b2056ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2056c7 expref: 22 pid: 6526 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.055451:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672448:0@lo:104: 00010000:00010000:2.0:1788850972.055461:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827eb000/0x3e0030720b20567a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205673 expref: 21 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.055469:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672576:0@lo:104: 00010000:00010000:2.0:1788850972.055479:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827ea800/0x3e0030720b20566c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205665 expref: 20 pid: 6528 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.055488:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672704:0@lo:104: 00000100:00100000:0.0:1788850972.055577:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019673088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788850972.055586:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019673216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788850972.056131:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019672832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788850972.056151:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019672960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788850972.058983:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875746019672192:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788850972.059056:0:10408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850972.062974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850972.063974:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739456 00000100:00100000:2.0:1788850972.063985:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739456 00010000:00010000:2.0:1788850972.064452:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3890f expref: 10 pid: 6528 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.064626:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:2.0:1788850972.064641:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2408:x1875746000739456:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788850972.064658:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850972.064665:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3890f expref: 10 pid: 6528 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064679:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3890f expref: 10 pid: 6528 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064697:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2154800/0x3e0030720b20590c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3890f expref: 10 pid: 6528 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064718:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064727:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064745:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064752:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064776:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064782:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064788:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788850972.064792:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064801:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064826:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.064838:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850972.064909:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:2408:x1875746000739456:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 273us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850972.064917:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00010000:00010000:1.0:1788850972.065886:0:10408:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.065899:0:10408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850972.065906:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6200/0x3e0030720b2059d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850972.601425:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019673344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788850972.601496:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850972.603414:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673344 00000100:00100000:1.0:1788850972.603427:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673344 00000100:00100000:1.0:1788850972.603481:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788850972.603492:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019673344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788850972.603538:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788850972.604426:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019673344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 931us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850972.604437:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788850972.604574:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019673344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788850972.722449:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850972.722564:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739584 00000100:00100000:2.0:1788850972.722577:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739584 00000100:00100000:2.0:1788850972.722772:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 252 00000100:00100000:2.0:1788850972.722788:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:6192:x1875746000739584:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850972.722827:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850972.722849:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38955 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.722880:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38955 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.722892:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38955 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850972.722901:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6000, rc 0) 00000100:00100000:2.0:1788850972.722971:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6192:x1875746000739584:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 189us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850972.722979:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 252 00000100:00100000:1.0:1788850972.725493:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850972.726181:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739712 00000100:00100000:0.0:1788850972.726192:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739712 00000100:00100000:0.0:1788850972.726259:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 253 00000100:00100000:0.0:1788850972.726270:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6192:x1875746000739712:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850972.726472:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6192:x1875746000739712:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 202us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850972.726481:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 253 00000100:00100000:0.0:1788850972.729924:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788850972.730122:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739840 00000100:00100000:3.0:1788850972.730133:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739840 00000100:00100000:3.0:1788850972.730188:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 254 00000100:00100000:3.0:1788850972.730198:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6192:x1875746000739840:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850972.730480:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6192:x1875746000739840:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 282us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850972.730488:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 254 00000100:00100000:1.0:1788850972.733707:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850972.734745:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739968 00000100:00100000:2.0:1788850972.734757:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739968 00000100:00100000:2.0:1788850972.734822:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:2.0:1788850972.734832:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6747:x1875746000739968:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788850972.734983:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6747:x1875746000739968:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 151us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850972.734991:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:1.0:1788850972.750457:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850972.752003:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740096 00000100:00100000:0.0:1788850972.752049:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740096 00000100:00100000:0.0:1788850972.752109:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:0.0:1788850972.752119:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6747:x1875746000740096:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788850972.752682:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:6747:x1875746000740096:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 562us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850972.752692:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 256 00010000:00010000:1.0:1788850972.852537:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788850973.816112:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788850973.816121:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea7c1e800 from 4 10000000:01000000:2.0:1788850973.816125:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788850973.816171:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.816186:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.816205:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850973.816413:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019673472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.816677:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.818039:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850973.821170:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673472 00000100:00100000:3.0:1788850973.821183:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673472 00000100:00100000:3.0:1788850973.821264:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788850973.821274:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019673472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850973.821306:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850973.821334:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2059de expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.821364:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2059de expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.821385:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2059de expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.821394:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030400, rc 0) 00000100:00100000:3.0:1788850973.821486:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019673472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (4810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.821494:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788850973.821943:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019673472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850973.821963:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.821973:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850973.822099:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019673600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.822140:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.822176:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850973.822651:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673600 00000100:00100000:0.0:1788850973.822657:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673600 00000100:00100000:0.0:1788850973.822710:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788850973.822717:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019673600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850973.822849:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019673600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850973.822856:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788850973.822923:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019673600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.822954:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019673728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.823002:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.823058:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850973.823106:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673728 00000100:00100000:0.0:1788850973.823110:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673728 00000100:00100000:0.0:1788850973.823139:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788850973.823146:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019673728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788850973.823229:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019673728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850973.823236:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788850973.823323:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019673728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.824607:0:10483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10483:1875746019673856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850973.824844:0:10483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.825049:0:10483:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64180 going to sleep for 11 seconds 00000100:00100000:3.0:1788850973.825853:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673856 00000100:00100000:3.0:1788850973.825862:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673856 00000100:00100000:3.0:1788850973.827257:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788850973.827272:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:10483:x1875746019673856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850973.827577:0:10483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10483:1875746019673856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850973.827627:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850973.827637:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850973.827639:0:10483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788850973.827647:0:10483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892ea7c1e800 00000020:00000080:2.0:1788850973.827650:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788850973.827763:0:10483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10483:1875746019673984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850973.827764:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:10483:x1875746019673856:12345-0@lo:502:llog_process_th.0 Request processed in 497us (2920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.827772:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788850973.827805:0:10483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.827833:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673984 00000100:00100000:2.0:1788850973.827839:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673984 00000100:00100000:2.0:1788850973.827868:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788850973.827875:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:10483:x1875746019673984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850973.827948:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:10483:x1875746019673984:12345-0@lo:502:llog_process_th.0 Request processed in 73us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.827955:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788850973.827990:0:10483:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64180 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.828002:0:10483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10483:1875746019673984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850973.828046:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850973.828050:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850973.828052:0:10483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788850973.828056:0:10483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788850973.828128:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788850973.828149:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788850973.828160:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850973.828177:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850973.828188:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788850973.828190:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea5900800 from 4 10000000:01000000:0.0:1788850973.828193:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788850973.828219:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850973.828227:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850973.828235:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850973.828249:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788850973.828277:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.828445:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788850973.831901:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674112 00000100:00100000:3.0:1788850973.831912:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674112 00000100:00100000:3.0:1788850973.832852:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788850973.832865:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019674112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850973.832953:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850973.832971:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2059ec expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.833001:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2059ec expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.833034:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2059ec expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.833055:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031400, rc 0) 00000100:00100000:3.0:1788850973.833130:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019674112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 268us (4851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.833137:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788850973.833243:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788850973.833263:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850973.833274:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850973.833445:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850973.833479:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.842687:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788850973.846531:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674240 00000100:00100000:1.0:1788850973.846549:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674240 00000100:00100000:1.0:1788850973.846613:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788850973.846623:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019674240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850973.846797:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019674240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (13317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850973.846805:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788850973.846809:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850973.846863:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788850973.846926:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.846960:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788850973.848390:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674368 00000100:00100000:3.0:1788850973.848400:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674368 00000100:00100000:3.0:1788850973.848442:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788850973.848451:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019674368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850973.848586:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019674368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.848594:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788850973.848643:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850973.852436:0:10488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10488:1875746019674496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850973.852527:0:10488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850973.852559:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674496 00000100:00100000:3.0:1788850973.852566:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674496 00000100:00100000:1.0:1788850973.852569:0:10488:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788850973.852613:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788850973.852622:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:10488:x1875746019674496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850973.852739:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:10488:x1875746019674496:12345-0@lo:502:llog_process_th.0 Request processed in 118us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.852748:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788850973.852809:0:10488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10488:1875746019674496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788850973.852835:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850973.852849:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850973.852851:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788850973.852857:0:10488:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892ea5900800 00000020:00000080:1.0:1788850973.852860:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788850973.853280:0:10488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10488:1875746019674624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850973.853435:0:10488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850973.853457:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674624 00000100:00100000:3.0:1788850973.853462:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674624 00000100:00100000:3.0:1788850973.853490:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788850973.853497:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:10488:x1875746019674624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850973.853619:0:10488:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788850973.853765:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:10488:x1875746019674624:12345-0@lo:502:llog_process_th.0 Request processed in 268us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.853778:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788850973.853786:0:10488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10488:1875746019674624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788850973.853806:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850973.853811:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850973.853813:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788850973.853817:0:10488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788850973.853955:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788850973.853983:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788850973.853992:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.854004:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850973.854029:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788850973.854032:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ebbbf6000 from 4 10000000:01000000:3.0:1788850973.854035:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788850973.854059:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.854068:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.854077:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850973.854092:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788850973.854120:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850973.854139:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e852ce480 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.854183:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674752 00000100:00100000:2.0:1788850973.854188:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674752 00000100:00100000:2.0:1788850973.854324:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788850973.854332:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019674752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850973.854343:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850973.854357:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2059fa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.854388:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2059fa expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.854398:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2059fa expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.854406:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6c00, rc 0) 00000100:00100000:2.0:1788850973.854444:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019674752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.854450:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788850973.856133:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850973.856157:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.856169:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850973.856258:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.856332:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.856364:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64180 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.856380:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674880 00000100:00100000:2.0:1788850973.856386:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674880 00000100:00100000:2.0:1788850973.856419:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788850973.856426:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019674880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.856558:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019674880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.856577:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788850973.856607:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019674880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.856634:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019675008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.856672:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.856684:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64180 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.856696:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675008 00000100:00100000:2.0:1788850973.856699:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675008 00000100:00100000:2.0:1788850973.856716:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788850973.856721:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019675008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.856796:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019675008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.856803:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788850973.856839:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019675008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.864180:0:10489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10489:1875746019675136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850973.864266:0:10489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.864964:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675136 00000100:00100000:2.0:1788850973.864974:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675136 00000100:00100000:2.0:1788850973.865116:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788850973.865127:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:10489:x1875746019675136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850973.865257:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:10489:x1875746019675136:12345-0@lo:502:llog_process_th.0 Request processed in 132us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.865266:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788850973.865788:0:10489:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.865815:0:10489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10489:1875746019675136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850973.865853:0:10489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850973.865863:0:10489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850973.865866:0:10489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788850973.865873:0:10489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892ebbbf6000 00000020:00000080:2.0:1788850973.865875:0:10489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788850973.866212:0:10489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10489:1875746019675264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850973.866259:0:10489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.866293:0:10489:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.869465:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675264 00000100:00100000:2.0:1788850973.869482:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675264 00000100:00100000:2.0:1788850973.869541:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788850973.869551:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:10489:x1875746019675264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850973.869711:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:10489:x1875746019675264:12345-0@lo:502:llog_process_th.0 Request processed in 161us (3451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.869720:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788850973.869781:0:10489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10489:1875746019675264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850973.869816:0:10489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850973.869823:0:10489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850973.869826:0:10489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788850973.869831:0:10489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788850973.869909:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788850973.869926:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788850973.869935:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.869947:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850973.869967:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788850973.869969:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e91596800 from 4 10000000:01000000:2.0:1788850973.869972:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788850973.869999:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.870008:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.870034:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850973.870053:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019675392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.870086:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.870113:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.870141:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675392 00000100:00100000:2.0:1788850973.870145:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675392 00000100:00100000:2.0:1788850973.870168:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788850973.870175:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019675392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850973.870183:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850973.870195:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205a08 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.870216:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205a08 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.870227:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a08 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.870247:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6800, rc 0) 00000100:00100000:2.0:1788850973.870276:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019675392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.870295:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788850973.870985:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019675392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850973.871002:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850973.871035:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850973.871095:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019675520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.871127:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.871147:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.871163:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675520 00000100:00100000:2.0:1788850973.871167:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675520 00000100:00100000:2.0:1788850973.871195:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788850973.871203:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019675520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.873086:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019675520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1878us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.873098:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788850973.873159:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019675520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.873202:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019675648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.873244:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.873279:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.874992:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675648 00000100:00100000:2.0:1788850973.875005:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675648 00000100:00100000:2.0:1788850973.875067:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788850973.875076:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019675648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850973.875229:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019675648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.875237:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788850973.875974:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019675648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850973.878321:0:10491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10491:1875746019675776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850973.878405:0:10491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850973.878446:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675776 00000100:00100000:3.0:1788850973.878448:0:10491:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e852ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.878454:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675776 00000100:00100000:2.0:1788850973.882725:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788850973.882746:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:10491:x1875746019675776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850973.882926:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:10491:x1875746019675776:12345-0@lo:502:llog_process_th.0 Request processed in 187us (4520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.882935:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00010000:3.0:1788850973.885074:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850973.885120:0:10491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10491:1875746019675776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788850973.885170:0:10491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788850973.885180:0:10491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788850973.885183:0:10491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788850973.885190:0:10491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892e91596800 00000020:00000080:3.0:1788850973.885193:0:10491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788850973.885295:0:10491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10491:1875746019675904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850973.885639:0:10491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850973.885688:0:10491:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e852ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850973.886776:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675904 00000100:00100000:2.0:1788850973.886787:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675904 00000100:00100000:2.0:1788850973.886843:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788850973.886854:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:10491:x1875746019675904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850973.887699:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:10491:x1875746019675904:12345-0@lo:502:llog_process_th.0 Request processed in 844us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850973.887708:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788850973.893792:0:10491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:10491:1875746019675904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788850973.893837:0:10491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788850973.893845:0:10491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788850973.893847:0:10491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788850973.893852:0:10491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788850973.894474:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788850973.894496:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788850973.894507:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850973.894520:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850974.644230:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019676160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788850974.644312:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850974.644385:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850974.644391:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019676288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788850974.644413:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850974.651665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019676928:0@lo:400:kworker.0 00000100:00100000:1.0:1788850974.651746:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850974.651783:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019677440:0@lo:400:kworker.0 00000100:00100000:1.0:1788850974.651809:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850974.651836:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019677952:0@lo:400:kworker.0 00000100:00100000:1.0:1788850974.651859:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850974.652105:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019676032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788850974.652131:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019676800:0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.652137:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850974.652148:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019676672:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.652156:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850974.652179:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676800 00000100:00100000:2.0:1788850974.652183:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850974.652186:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676800 00000100:00100000:2.0:1788850974.652201:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019677184:0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.652220:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850974.652237:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019677696:0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.652257:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850974.652286:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788850974.652292:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019676544:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.652314:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788850974.652318:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850974.652323:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019676800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.652337:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019677056:0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.652353:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850974.652363:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019677568:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.652369:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019676800:12345-0@lo:400:kworker.0 Request processed in 48us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850974.652376:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788850974.652379:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850974.652390:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677056 00000100:00100000:0.0:1788850974.652393:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677056 00000100:00100000:2.0:1788850974.652398:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676160 00000100:00100000:2.0:1788850974.652402:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676160 00000100:00100000:0.0:1788850974.652406:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788850974.652411:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019677056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.652444:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019677056:12345-0@lo:400:kworker.0 Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850974.652450:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788850974.652493:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019676800:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.652500:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019677312:0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.652565:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676288 00000100:00100000:2.0:1788850974.652570:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676288 00000100:00100000:2.0:1788850974.652584:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676032 00000100:00100000:2.0:1788850974.652587:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676032 00000100:00100000:2.0:1788850974.652600:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788850974.652606:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019676160:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788850974.652742:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677440 00000100:00100000:1.0:1788850974.652746:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677440 00000100:00100000:1.0:1788850974.652770:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677952 00000100:00100000:1.0:1788850974.652773:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677952 00000100:00100000:1.0:1788850974.652792:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788850974.652798:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019677440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.653029:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850974.653046:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019677824:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.653068:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788850974.653101:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850974.653146:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019676160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 540us (8834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.653153:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788850974.653167:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788850974.653173:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019676288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788850974.653196:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850974.653226:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019676288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (8812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.653232:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788850974.653245:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850974.653251:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019676032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788850974.653261:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850974.653297:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019676032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.653303:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850974.653324:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676928 00000100:00100000:2.0:1788850974.653327:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676928 00000100:00100000:2.0:1788850974.653347:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676672 00000100:00100000:2.0:1788850974.653351:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676672 00000100:00100000:2.0:1788850974.653364:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677184 00000100:00100000:2.0:1788850974.653367:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677184 00000100:00100000:3.0:1788850974.653375:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677696 00000100:00100000:3.0:1788850974.653382:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677696 00000100:00100000:2.0:1788850974.653383:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677568 00000100:00100000:2.0:1788850974.653389:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677568 00000100:00100000:3.0:1788850974.653413:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677312 00000100:00100000:3.0:1788850974.653418:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677312 00000100:00100000:0.0:1788850974.653498:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677824 00000100:00100000:0.0:1788850974.653502:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677824 00000100:00100000:1.0:1788850974.653504:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019677440:12345-0@lo:400:kworker.0 Request processed in 706us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850974.653511:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788850974.653530:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788850974.653537:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019677952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850974.653567:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019677952:12345-0@lo:400:kworker.0 Request processed in 31us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850974.653573:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788850974.653607:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87baa300 x1875746019677440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850974.653618:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019677440:0@lo:400:kworker.0 00010000:00080000:1.0:1788850974.653627:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba9500 x1875746019677952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850974.653634:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019677952:0@lo:400:kworker.0 00010000:00080000:1.0:1788850974.653671:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd7800 x1875746019676288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850974.653685:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019676288:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788850974.653696:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c64a80 x1875746019676160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850974.653707:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019676160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788850974.653739:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676544 00000100:00100000:1.0:1788850974.653742:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676544 00000100:00100000:1.0:1788850974.653769:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788850974.653775:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019676544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850974.653805:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019676544:12345-0@lo:400:kworker.0 Request processed in 30us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850974.653810:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788850974.653860:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788850974.653907:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788850974.653915:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019677824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850974.653921:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788850974.653933:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019676672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.653961:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019677824:12345-0@lo:400:kworker.0 Request processed in 47us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850974.653968:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788850974.654001:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bab800 x1875746019677824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850974.654010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019677824:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.654053:0:9543:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788850974.654061:0:9543:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:0.0:1788850974.654085:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788850974.654089:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788850974.654092:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788850974.654093:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788850974.654106:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019676544:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.654116:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019677056:0@lo:400:kworker.0 00010000:00080000:0.0:1788850974.654125:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba9f80 x1875746019676032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850974.654148:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019676032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788850974.654172:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019676672:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.654186:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788850974.654359:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019676928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.654399:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019676928:12345-0@lo:400:kworker.0 Request processed in 533us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.654405:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788850974.654493:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788850974.654501:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019677184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.654531:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019677184:12345-0@lo:400:kworker.0 Request processed in 31us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.654547:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788850974.654560:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788850974.654565:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019677696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.654595:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019677696:12345-0@lo:400:kworker.0 Request processed in 30us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.654600:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788850974.654612:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788850974.654617:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019677568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.654642:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019677568:12345-0@lo:400:kworker.0 Request processed in 26us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.654647:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788850974.654658:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788850974.654664:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019677312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.654696:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019677312:12345-0@lo:400:kworker.0 Request processed in 33us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.654701:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788850974.654729:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019676928:0@lo:400:kworker.0 00000100:00100000:3.0:1788850974.654819:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019676672:12345-0@lo:400:kworker.0 Request processed in 64us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850974.654908:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788850974.655096:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba8000 x1875746019677312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850974.655107:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019677312:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.655249:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019676416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788850974.655301:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850974.655339:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019677568:0@lo:400:kworker.0 00000100:00100000:0.0:1788850974.655349:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019677184:0@lo:400:kworker.0 00010000:00080000:0.0:1788850974.655360:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba8700 x1875746019677696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850974.655367:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019677696:0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.655502:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676416 00000100:00100000:2.0:1788850974.655507:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676416 00000100:00100000:2.0:1788850974.655542:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788850974.655549:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019676416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788850974.655564:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788850974.655649:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019676416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.655665:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788850974.655720:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca1c00 x1875746019676416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850974.655734:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019676416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788850974.905471:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850975.668552:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850975.668584:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019678080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788850975.668660:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850975.668783:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678080 00000100:00100000:3.0:1788850975.668791:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678080 00000100:00100000:3.0:1788850975.668851:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788850975.668861:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019678080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788850975.668895:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788850975.669071:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019678080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 211us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850975.669078:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788850975.669174:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019678080:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788850975.928541:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850976.953429:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850977.010875:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850977.010925:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850977.010936:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740224 00000100:00100000:2.0:1788850977.010947:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740224 00000100:00100000:0.0:1788850977.010962:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850977.010992:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850977.011003:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 278 00000100:00100000:0.0:1788850977.011035:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850977.011046:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000740224:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788850977.011058:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740736 00000100:00100000:0.0:1788850977.011061:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740736 00000100:00100000:2.0:1788850977.011122:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000740224:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 110us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850977.011130:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 278 00000100:00100000:3.0:1788850977.011270:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740480 00000100:00100000:3.0:1788850977.011275:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740480 00000100:00100000:3.0:1788850977.011315:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740352 00000100:00100000:3.0:1788850977.011317:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740352 00000100:00100000:3.0:1788850977.011337:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:3.0:1788850977.011345:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000740480:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788850977.011384:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000740480:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 41us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850977.011403:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:0.0:1788850977.011597:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740608 00000100:00100000:0.0:1788850977.011601:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740608 00000100:00100000:2.0:1788850977.011620:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1788850977.011627:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000740736:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788850977.011634:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1788850977.011641:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000740608:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788850977.011653:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000740736:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850977.011659:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1788850977.011662:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000740608:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850977.011667:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:3.0:1788850977.011808:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:3.0:1788850977.011817:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000740352:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788850977.011845:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000740352:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850977.011851:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00080000:3.0:1788850977.011872:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788850977.011877:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788850977.011880:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788850977.011888:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788850977.723090:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788850977.723118:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019678208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788850977.723202:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850977.723283:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678208 00000100:00100000:3.0:1788850977.723290:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678208 00000100:00100000:3.0:1788850977.729490:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788850977.729513:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019678208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788850977.729557:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788850977.729646:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019678208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (6444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850977.729653:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788850977.729716:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019678208:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788850977.974874:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850979.001164:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788850979.220617:0:10709:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788850979.764323:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788850979.764349:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019678336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788850979.764418:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850979.764505:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678336 00000100:00100000:3.0:1788850979.764513:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678336 00000100:00100000:3.0:1788850979.764562:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788850979.764573:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019678336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788850979.764601:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850979.764641:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019678336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850979.764648:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788850979.764667:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788850979.764698:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca0e00 x1875746019678336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850979.764752:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019678336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788850979.765418:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019678592:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.765476:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.765509:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019679104:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.765536:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.765553:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019679616:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.765590:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.765612:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019680128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788850979.765634:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.765650:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788850979.765655:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019678464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788850979.765672:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.765684:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019678976:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.765704:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.765717:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019679488:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.765753:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.765770:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019680000:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.765788:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.765819:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678592 00000100:00100000:0.0:1788850979.765832:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678592 00000100:00100000:0.0:1788850979.765871:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788850979.765880:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019678592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.765923:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019678592:12345-0@lo:400:kworker.0 Request processed in 44us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850979.765930:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788850979.765958:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679616 00000100:00100000:0.0:1788850979.765962:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679616 00000100:00100000:0.0:1788850979.765989:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679488 00000100:00100000:0.0:1788850979.765992:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679488 00000100:00100000:0.0:1788850979.766006:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680000 00000100:00100000:0.0:1788850979.766009:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680000 00000100:00100000:0.0:1788850979.766051:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788850979.766057:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019679616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766087:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019679616:12345-0@lo:400:kworker.0 Request processed in 30us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850979.766093:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788850979.766120:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788850979.766126:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019679488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766152:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019679488:12345-0@lo:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850979.766157:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788850979.766181:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788850979.766188:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019680000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766215:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019680000:12345-0@lo:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850979.766221:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788850979.766261:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019678848:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766302:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.766323:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019679360:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766344:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.766358:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019679872:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766377:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.766394:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788850979.766400:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019678720:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766421:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.766436:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019679232:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766454:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.766469:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019679744:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.766510:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679104 00000100:00100000:0.0:1788850979.766515:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679104 00000100:00100000:0.0:1788850979.766538:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678848 00000100:00100000:0.0:1788850979.766541:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678848 00000100:00100000:0.0:1788850979.766554:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788850979.766560:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019679104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766592:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019679104:12345-0@lo:400:kworker.0 Request processed in 32us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850979.766598:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788850979.766609:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788850979.766615:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019678848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766645:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019678848:12345-0@lo:400:kworker.0 Request processed in 30us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850979.766661:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788850979.766691:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019678848:0@lo:400:kworker.0 00010000:00080000:0.0:1788850979.766714:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba9180 x1875746019679488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850979.766725:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019679488:0@lo:400:kworker.0 00010000:00080000:0.0:1788850979.766734:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87baad80 x1875746019680000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850979.766742:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019680000:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766749:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019678592:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.766757:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019679104:0@lo:400:kworker.0 00010000:00080000:0.0:1788850979.766766:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba9880 x1875746019679616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850979.766774:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019679616:0@lo:400:kworker.0 00000100:00100000:3.0:1788850979.767793:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678976 00000100:00100000:3.0:1788850979.767800:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678976 00000100:00100000:3.0:1788850979.767833:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679360 00000100:00100000:3.0:1788850979.767836:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679360 00000100:00100000:3.0:1788850979.767853:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679872 00000100:00100000:3.0:1788850979.767855:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679872 00000100:00100000:3.0:1788850979.767867:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678720 00000100:00100000:3.0:1788850979.767870:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678720 00000100:00100000:3.0:1788850979.767880:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679232 00000100:00100000:3.0:1788850979.767883:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679232 00000100:00100000:3.0:1788850979.767895:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679744 00000100:00100000:3.0:1788850979.767898:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679744 00000100:00100000:3.0:1788850979.767915:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788850979.767922:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019678976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850979.768007:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019678976:12345-0@lo:400:kworker.0 Request processed in 85us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850979.768030:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788850979.768045:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788850979.768051:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019679360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850979.768079:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019679360:12345-0@lo:400:kworker.0 Request processed in 28us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850979.768085:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788850979.768095:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788850979.768370:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019679872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850979.768402:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019679872:12345-0@lo:400:kworker.0 Request processed in 302us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850979.768422:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788850979.768434:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788850979.768440:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019678720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850979.768596:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019678720:12345-0@lo:400:kworker.0 Request processed in 156us (2174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850979.768603:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788850979.768615:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788850979.768621:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019679232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850979.768648:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019679232:12345-0@lo:400:kworker.0 Request processed in 28us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850979.768654:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788850979.768664:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788850979.769768:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019679744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850979.769825:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019679744:12345-0@lo:400:kworker.0 Request processed in 65us (3337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850979.779997:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680128 00000100:00100000:1.0:1788850979.780028:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680128 00000100:00100000:1.0:1788850979.780066:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678464 00000100:00100000:1.0:1788850979.780069:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678464 00000100:00100000:1.0:1788850979.780087:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788850979.780098:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019680128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788850979.780795:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850979.780886:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019680128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 788us (15249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850979.780894:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788850979.780915:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788850979.780923:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019678464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788850979.780932:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850979.780957:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019678464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (15284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850979.780963:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788850979.780984:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788850979.780990:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788850979.780993:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788850979.780996:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788850979.781041:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019680256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788850979.781084:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850979.781969:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680256 00000100:00100000:0.0:1788850979.781979:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680256 00000100:00100000:1.0:1788850979.782289:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788850979.782298:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019680256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788850979.782326:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850979.782384:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019680256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850979.782391:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788850979.782644:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca0e00 x1875746019680256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850979.782664:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019680256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788850979.783125:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019678720:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.783140:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019679232:0@lo:400:kworker.0 00000100:00100000:0.0:1788850979.783151:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019679744:0@lo:400:kworker.0 00010000:00080000:0.0:1788850979.783165:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87babb80 x1875746019679360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850979.783184:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019679360:0@lo:400:kworker.0 00010000:00080000:0.0:1788850979.783208:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bab100 x1875746019679872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850979.783218:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019679872:0@lo:400:kworker.0 00000100:00100000:3.0:1788850979.787821:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1788850979.787974:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba8000 x1875746019678464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850979.788000:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019678464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788850979.788257:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019678976:0@lo:400:kworker.0 00010000:00080000:3.0:1788850979.788274:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5ad6a00 x1875746019680128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850979.788286:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019680128:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788850980.020511:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850980.788397:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788850980.788422:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019680384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788850980.788494:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850980.788624:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680384 00000100:00100000:2.0:1788850980.788633:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680384 00000100:00100000:2.0:1788850980.788679:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788850980.788689:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019680384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788850980.788723:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788850980.788793:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019680384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850980.788800:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788850980.788883:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019680384:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788850981.044782:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850982.072429:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850982.138446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850982.138491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788850982.138525:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850982.139108:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741120 00000100:00100000:1.0:1788850982.139119:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741120 00000100:00080000:0.0:1788850982.139189:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788850982.139199:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740992 00000100:00100000:1.0:1788850982.139202:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740992 00000100:00100000:0.0:1788850982.139205:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:0.0:1788850982.139218:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000741120:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788850982.139226:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:1.0:1788850982.139233:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000740992:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788850982.139308:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740864 00000100:00100000:3.0:1788850982.139313:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740864 00000100:00100000:3.0:1788850982.139352:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 280 00000100:00100000:3.0:1788850982.139359:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2408:x1875746000740864:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788850982.139421:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000740992:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 187us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850982.139429:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:0.0:1788850982.139480:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000741120:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 265us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850982.139488:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00080000:0.0:1788850982.139523:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850982.146396:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2408:x1875746000740864:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 7024us (7948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850982.146412:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 280 00000100:00100000:1.0:1788850982.149060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850982.152775:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850982.152845:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741248 00000100:00100000:1.0:1788850982.152864:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741248 00000100:00100000:1.0:1788850982.152936:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741376 00000100:00100000:1.0:1788850982.152940:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741376 00000100:00100000:1.0:1788850982.152966:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1788850982.152977:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2406:x1875746000741248:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:1.0:1788850982.153029:0:8447:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205921 00000100:00080000:1.0:1788850982.153041:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892d876be800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788850982.153091:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788850982.153256:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+2:2406:x1875746000741248:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 281us (4210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850982.153264:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1788850982.153280:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788850982.153287:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2406:x1875746000741376:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:1.0:1788850982.153300:0:8447:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205928 00000100:00080000:1.0:1788850982.153307:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892d876bf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788850982.153606:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788850982.153686:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+2:2406:x1875746000741376:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 399us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850982.153693:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00010000:00010000:1.0:1788850982.153770:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850982.153776:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788850982.153783:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788850982.153787:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788850982.837339:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788850982.837363:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019680512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788850982.837434:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850982.837513:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680512 00000100:00100000:0.0:1788850982.837521:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680512 00000100:00100000:0.0:1788850982.837568:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788850982.837578:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019680512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788850982.837611:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788850982.837656:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019680512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850982.837663:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788850982.837709:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019680512:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788850983.094202:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850984.116370:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788850984.811330:0:10953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing yml_node 00000100:00100000:1.0:1788850984.884236:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019681024:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884297:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884340:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019681536:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884367:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884386:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019682048:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884402:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884420:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788850984.884425:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019680640:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884445:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884460:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019681152:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884477:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884488:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019681664:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884501:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884513:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019682176:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884529:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884547:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019680768:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884563:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884576:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019681280:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884591:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019681792:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884617:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884628:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788850984.884633:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019680896:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884647:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884657:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019681408:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884670:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884680:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019681920:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884703:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850984.884722:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681536 00000100:00100000:1.0:1788850984.884728:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681536 00000100:00100000:1.0:1788850984.884767:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682048 00000100:00100000:1.0:1788850984.884770:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682048 00000100:00100000:1.0:1788850984.884779:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681664 00000100:00100000:1.0:1788850984.884781:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681664 00000100:00100000:1.0:1788850984.884792:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682176 00000100:00100000:1.0:1788850984.884794:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682176 00000100:00100000:1.0:1788850984.884807:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788850984.884815:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019681536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884859:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019681536:12345-0@lo:400:kworker.0 Request processed in 45us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.884865:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788850984.884880:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788850984.884885:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019682048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884905:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019682048:12345-0@lo:400:kworker.0 Request processed in 21us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.884911:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788850984.884919:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788850984.884924:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019681664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884941:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019681664:12345-0@lo:400:kworker.0 Request processed in 18us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.884947:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788850984.884955:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788850984.884959:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019682176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.884977:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019682176:12345-0@lo:400:kworker.0 Request processed in 18us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.884987:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788850984.885171:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681024 00000100:00100000:1.0:1788850984.885175:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681024 00000100:00100000:1.0:1788850984.885191:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680768 00000100:00100000:1.0:1788850984.885193:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680768 00000100:00100000:1.0:1788850984.885201:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681280 00000100:00100000:1.0:1788850984.885203:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681280 00000100:00100000:1.0:1788850984.885211:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681792 00000100:00100000:1.0:1788850984.885213:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681792 00000100:00100000:1.0:1788850984.885221:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681408 00000100:00100000:1.0:1788850984.885223:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681408 00000100:00100000:1.0:1788850984.885232:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681920 00000100:00100000:1.0:1788850984.885234:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681920 00000100:00100000:1.0:1788850984.885245:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788850984.885251:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019681024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885278:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019681024:12345-0@lo:400:kworker.0 Request processed in 28us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.885283:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788850984.885293:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788850984.885297:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019680768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885319:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019680768:12345-0@lo:400:kworker.0 Request processed in 21us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.885324:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788850984.885333:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788850984.885337:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019681280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885356:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019681280:12345-0@lo:400:kworker.0 Request processed in 19us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.885361:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788850984.885376:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788850984.885381:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019681792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885403:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019681792:12345-0@lo:400:kworker.0 Request processed in 22us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.885408:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788850984.885416:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788850984.885420:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019681408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885438:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019681408:12345-0@lo:400:kworker.0 Request processed in 18us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.885443:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788850984.885451:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788850984.885456:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019681920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885473:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019681920:12345-0@lo:400:kworker.0 Request processed in 18us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.885479:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788850984.885494:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788850984.885497:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788850984.885500:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788850984.885502:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788850984.885525:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba8700 x1875746019681408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850984.885540:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019681408:0@lo:400:kworker.0 00010000:00080000:1.0:1788850984.885548:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba8a80 x1875746019681920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850984.885556:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019681920:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885573:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019680768:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885580:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019681280:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885587:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019681792:0@lo:400:kworker.0 00010000:00080000:1.0:1788850984.885615:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87baad80 x1875746019681664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850984.885623:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019681664:0@lo:400:kworker.0 00010000:00080000:1.0:1788850984.885631:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88153800 x1875746019682176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850984.885638:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019682176:0@lo:400:kworker.0 00000100:00100000:1.0:1788850984.885646:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019681024:0@lo:400:kworker.0 00010000:00080000:1.0:1788850984.885654:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ba9500 x1875746019681536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850984.885661:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019681536:0@lo:400:kworker.0 00010000:00080000:1.0:1788850984.885669:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88150700 x1875746019682048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850984.885675:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019682048:0@lo:400:kworker.0 00000100:00100000:0.0:1788850984.885782:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680640 00000100:00100000:0.0:1788850984.885786:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680640 00000100:00100000:0.0:1788850984.885812:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788850984.885817:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019680640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850984.885851:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019680640:12345-0@lo:400:kworker.0 Request processed in 34us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850984.885857:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788850984.885878:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681152 00000100:00100000:0.0:1788850984.885881:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681152 00000100:00100000:0.0:1788850984.885894:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680896 00000100:00100000:0.0:1788850984.885896:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680896 00000100:00100000:0.0:1788850984.885906:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788850984.885910:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019681152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850984.885934:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019681152:12345-0@lo:400:kworker.0 Request processed in 24us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850984.885940:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788850984.885948:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788850984.885953:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019680896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850984.885976:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019680896:12345-0@lo:400:kworker.0 Request processed in 23us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850984.885981:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788850984.886029:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019680896:0@lo:400:kworker.0 00000100:00100000:0.0:1788850984.886048:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019680640:0@lo:400:kworker.0 00000100:00100000:0.0:1788850984.886056:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019681152:0@lo:400:kworker.0 00000100:00100000:3.0:1788850984.886233:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019682432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788850984.886268:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850984.886293:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788850984.886298:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019682304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788850984.886316:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850984.886336:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788850984.886341:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019682560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788850984.886360:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850984.886377:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682432 00000100:00100000:3.0:1788850984.886381:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682432 00000100:00100000:3.0:1788850984.886400:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682304 00000100:00100000:3.0:1788850984.886402:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682304 00000100:00100000:3.0:1788850984.886412:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682560 00000100:00100000:3.0:1788850984.886414:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682560 00000100:00100000:3.0:1788850984.886424:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788850984.886429:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019682432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788850984.886449:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850984.886480:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019682432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850984.886486:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788850984.886504:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788850984.886509:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019682304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788850984.886522:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850984.886544:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019682304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850984.886549:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788850984.886558:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788850984.886563:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019682560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788850984.886570:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850984.886590:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019682560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850984.886595:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788850984.886615:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca0380 x1875746019682560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850984.886627:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019682560:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788850984.886644:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca2680 x1875746019682304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850984.886653:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019682304:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788850984.886660:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca1c00 x1875746019682432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850984.886669:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019682432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788850984.886784:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019682688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788850984.886806:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850984.886878:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682688 00000100:00100000:0.0:1788850984.886882:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682688 00000100:00100000:0.0:1788850984.886913:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788850984.886919:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019682688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788850984.886929:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788850984.886959:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019682688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850984.886964:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788850984.886986:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b75c00 x1875746019682688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850984.886996:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019682688:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788850985.140839:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850985.914320:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788850985.914342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019682816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788850985.914418:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850985.914566:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682816 00000100:00100000:3.0:1788850985.914574:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682816 00000100:00100000:3.0:1788850985.914627:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788850985.914636:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019682816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788850985.914667:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788850985.914731:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019682816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850985.914737:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788850985.914780:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019682816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788850986.165106:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850987.188325:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850987.254285:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850987.254325:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850987.254366:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850987.254394:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741632 00000100:00100000:0.0:1788850987.254395:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741760 00000100:00100000:1.0:1788850987.254404:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741632 00000100:00100000:0.0:1788850987.254404:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741760 00000100:00100000:0.0:1788850987.254470:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:3.0:1788850987.254555:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741504 00000100:00100000:3.0:1788850987.254559:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741504 00000100:00100000:0.0:1788850987.254561:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000741760:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788850987.254588:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 282 00000100:00100000:3.0:1788850987.254594:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000741504:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788850987.254657:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000741504:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 51us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850987.254666:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 282 00000100:00100000:0.0:1788850987.254960:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000741760:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 403us (633us total) trans 0 rc 0/0 00000100:00080000:3.0:1788850987.261463:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788850987.261473:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788850987.268456:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:1.0:1788850987.268484:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000741632:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788850987.268592:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000741632:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 122us (14223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850987.276767:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:1.0:1788850987.285655:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:1.0:1788850987.958936:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788850987.958969:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019682944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788850987.959077:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850987.959403:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682944 00000100:00100000:0.0:1788850987.959413:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682944 00000100:00100000:0.0:1788850987.959473:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788850987.959482:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019682944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788850987.961348:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788850987.961450:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019682944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1966us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850987.961469:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788850987.961914:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019682944:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788850987.963473:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:2.0:1788850987.963481:0:8443:0:(genops.c:885:class_export_put()) final put ffff892d876b9000/a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:0.0:1788850987.964368:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d876b9000/a99889d1-fa00-4984-a18e-0736ff414641 for lustre-OST0000 00000020:00000080:0.0:1788850987.964436:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d876be800 for lustre-OST0000 00000001:00100000:0.0:1788850987.966099:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:0.0:1788850987.966108:0:9528:0:(genops.c:885:class_export_put()) final put ffff892d876bd800/a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:1.0:1788850987.966642:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d876bd800/a99889d1-fa00-4984-a18e-0736ff414641 for lustre-OST0001 00000020:00000080:1.0:1788850987.966716:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d876bf800 for lustre-OST0001 00010000:00010000:2.0:1788850988.212321:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850989.244541:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850989.977057:0:11136:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:3.0:1788850990.004457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019683072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788850990.004533:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850990.004598:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788850990.004606:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019683200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788850990.004630:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850990.004665:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683072 00000100:00100000:3.0:1788850990.004672:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683072 00000100:00100000:3.0:1788850990.004716:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683200 00000100:00100000:0.0:1788850990.005004:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019683712:0@lo:400:kworker.0 00000100:00080000:2.0:1788850990.005059:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788850990.005072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005098:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019684224:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005121:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005321:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019684736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788850990.005350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005363:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788850990.005369:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019683584:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005395:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005411:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019684096:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005431:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005451:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019684608:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005470:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005496:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019683328:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005528:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005551:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019683840:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005574:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005591:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019684352:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005623:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005644:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788850990.005651:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019683456:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005673:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005692:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019683968:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005712:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005726:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019684480:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005745:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850990.005769:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683328 00000100:00100000:0.0:1788850990.005775:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683328 00000100:00100000:0.0:1788850990.005808:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788850990.005817:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019683328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005868:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019683328:12345-0@lo:400:kworker.0 Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850990.005876:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788850990.005907:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683584 00000100:00100000:0.0:1788850990.005911:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683584 00000100:00100000:0.0:1788850990.005928:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683840 00000100:00100000:0.0:1788850990.005930:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683840 00000100:00100000:0.0:1788850990.005942:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788850990.005947:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019683584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.005999:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019683584:12345-0@lo:400:kworker.0 Request processed in 50us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850990.006005:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788850990.006041:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788850990.006049:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019683840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.006093:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019683840:12345-0@lo:400:kworker.0 Request processed in 44us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850990.006100:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788850990.006121:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683712 00000100:00100000:2.0:1788850990.006390:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684736 00000100:00100000:2.0:1788850990.006396:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684736 00000100:00100000:1.0:1788850990.006407:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684224 00000100:00100000:1.0:1788850990.006413:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684224 00000100:00100000:2.0:1788850990.006432:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788850990.006443:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019683072:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788850990.006450:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684608 00000100:00100000:1.0:1788850990.006455:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684608 00002000:00000024:2.0:1788850990.006466:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850990.006479:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788850990.006488:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019684224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850990.006510:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019683072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850990.006518:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788850990.006536:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019684224:12345-0@lo:400:kworker.0 Request processed in 49us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850990.006537:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788850990.006548:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788850990.006551:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019684736:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788850990.006568:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00002000:00000024:2.0:1788850990.006571:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850990.006577:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019684608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850990.006610:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019684736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850990.006616:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788850990.006619:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019684608:12345-0@lo:400:kworker.0 Request processed in 44us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850990.006630:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850990.006649:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684096 00000100:00100000:2.0:1788850990.006654:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684096 00000100:00100000:1.0:1788850990.006663:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684352 00000100:00100000:1.0:1788850990.006675:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684352 00000100:00100000:2.0:1788850990.006678:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683456 00000100:00100000:2.0:1788850990.006683:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683456 00000100:00100000:1.0:1788850990.006699:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683968 00000100:00100000:1.0:1788850990.006704:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683968 00000100:00100000:2.0:1788850990.006705:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684480 00000100:00100000:2.0:1788850990.006710:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684480 00000100:00100000:1.0:1788850990.006727:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788850990.006735:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019684096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850990.006766:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019684096:12345-0@lo:400:kworker.0 Request processed in 32us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850990.006772:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788850990.006783:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788850990.006789:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019684352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850990.006813:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019684352:12345-0@lo:400:kworker.0 Request processed in 25us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850990.006818:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788850990.006828:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788850990.006834:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019683456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850990.006859:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019683456:12345-0@lo:400:kworker.0 Request processed in 26us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850990.006864:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788850990.006874:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788850990.006879:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019683968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850990.006901:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019683968:12345-0@lo:400:kworker.0 Request processed in 22us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850990.006906:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788850990.006919:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850990.006929:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019684864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788850990.006956:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850990.007204:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788850990.007211:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019684480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850990.007258:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019684480:12345-0@lo:400:kworker.0 Request processed in 38us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850990.007484:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683200 00000100:00100000:3.0:1788850990.007511:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684864 00000100:00100000:3.0:1788850990.007514:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684864 00000100:00100000:3.0:1788850990.007528:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788850990.007535:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019683200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788850990.007547:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850990.007581:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019683200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850990.007587:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788850990.007599:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788850990.007605:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019684864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788850990.007614:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850990.007654:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019684864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850990.007660:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788850990.007806:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788850990.007829:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788850990.007833:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788850990.007836:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850990.007838:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788850990.007892:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca0380 x1875746019683200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850990.007993:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019683200:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788850990.008048:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca2680 x1875746019683072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850990.008062:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019683072:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788850990.008294:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88151c00 x1875746019684864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850990.008310:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019684864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788850990.008476:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019683456:0@lo:400:kworker.0 00000100:00100000:3.0:1788850990.008489:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019683968:0@lo:400:kworker.0 00010000:00080000:3.0:1788850990.008500:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8813e680 x1875746019684480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850990.008509:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019684480:0@lo:400:kworker.0 00000100:00100000:3.0:1788850990.008518:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019683328:0@lo:400:kworker.0 00000100:00100000:3.0:1788850990.008529:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019683840:0@lo:400:kworker.0 00000100:00100000:3.0:1788850990.008538:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019684352:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.008582:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683712 00000100:00100000:0.0:1788850990.008619:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019683584:0@lo:400:kworker.0 00010000:00080000:0.0:1788850990.008633:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8813d500 x1875746019684096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850990.008643:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019684096:0@lo:400:kworker.0 00010000:00080000:0.0:1788850990.008655:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8813ca80 x1875746019684608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850990.008663:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019684608:0@lo:400:kworker.0 00010000:00080000:0.0:1788850990.008674:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd6680 x1875746019684736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850990.008687:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019684736:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788850990.008696:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8813c380 x1875746019684224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850990.008704:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019684224:0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.008765:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788850990.008773:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019683712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850990.008832:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019683712:12345-0@lo:400:kworker.0 Request processed in 59us (3761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850990.008838:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788850990.010001:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019683712:0@lo:400:kworker.0 00010000:00010000:2.0:1788850990.260321:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850991.038179:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850991.038204:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019684992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788850991.038279:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850991.038395:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684992 00000100:00100000:0.0:1788850991.038404:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684992 00000100:00100000:0.0:1788850991.038459:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788850991.038468:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019684992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788850991.038505:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788850991.038555:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019684992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850991.038561:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788850991.038601:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019684992:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788850991.292521:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850992.310538:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850992.369893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850992.369967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788850992.370010:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850992.370094:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741888 00000100:00100000:2.0:1788850992.370104:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741888 00000100:00100000:3.0:1788850992.370148:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742016 00000100:00100000:3.0:1788850992.370154:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742016 00000100:00100000:2.0:1788850992.370182:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 284 00000100:00100000:2.0:1788850992.370193:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2409:x1875746000741888:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788850992.370204:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742144 00000100:00100000:3.0:1788850992.370209:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742144 00000100:00100000:2.0:1788850992.370272:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2409:x1875746000741888:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 81us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850992.370281:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 284 00000100:00100000:2.0:1788850992.372660:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:2.0:1788850992.372677:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000742016:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788850992.372700:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:3.0:1788850992.372715:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000742144:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788850992.372782:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000742016:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 111us (2919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850992.372789:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00080000:2.0:1788850992.372815:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788850992.372820:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850992.374308:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000742144:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 1591us (4289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850992.374322:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 100 00000001:02000400:1.0:1788850992.937596:0:11234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:2.0:1788850993.076452:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019685120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788850993.076523:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850993.076828:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685120 00000100:00100000:2.0:1788850993.076836:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685120 00000100:00100000:2.0:1788850993.076935:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788850993.076946:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019685120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788850993.076994:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788850993.077058:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019685120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850993.077066:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788850993.078810:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019685120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788850993.332946:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850994.357282:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850995.124355:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019685376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788850995.124422:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850995.124680:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019685248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788850995.124714:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850995.124763:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685376 00000100:00100000:3.0:1788850995.124771:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685376 00000100:00100000:3.0:1788850995.124815:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685248 00000100:00100000:3.0:1788850995.124817:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685248 00000100:00100000:3.0:1788850995.124833:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788850995.124846:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019685376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788850995.124887:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850995.124936:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019685376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850995.124944:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788850995.124953:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019685504:0@lo:400:kworker.0 00000100:00100000:3.0:1788850995.124962:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788850995.124970:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019685248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788850995.124984:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788850995.124997:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850995.125051:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019685248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850995.125053:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019686016:0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125083:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850995.125087:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788850995.125107:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019686528:0@lo:400:kworker.0 00000100:00100000:3.0:1788850995.125109:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685504 00000100:00100000:3.0:1788850995.125115:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685504 00000100:00100000:1.0:1788850995.125137:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850995.125145:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788850995.125153:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019685504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125162:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788850995.125171:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019685888:0@lo:400:kworker.0 00000100:00100000:3.0:1788850995.125193:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019685504:12345-0@lo:400:kworker.0 Request processed in 41us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850995.125199:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788850995.125217:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850995.125237:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019686400:0@lo:400:kworker.0 00000100:00100000:3.0:1788850995.125245:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686016 00000100:00100000:3.0:1788850995.125250:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686016 00000100:00100000:1.0:1788850995.125265:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850995.125282:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788850995.125291:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019686016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125302:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019685504:0@lo:400:kworker.0 00000100:00100000:3.0:1788850995.125332:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019686016:12345-0@lo:400:kworker.0 Request processed in 42us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850995.125338:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788850995.125351:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686528 00000100:00100000:1.0:1788850995.125356:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686528 00000100:00100000:1.0:1788850995.125385:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685888 00000100:00100000:1.0:1788850995.125388:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685888 00000100:00100000:1.0:1788850995.125408:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788850995.125415:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019686528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125454:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019686528:12345-0@lo:400:kworker.0 Request processed in 40us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850995.125461:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788850995.125474:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788850995.125479:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019685888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125502:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019685888:12345-0@lo:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850995.125507:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788850995.125524:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686400 00000100:00100000:1.0:1788850995.125527:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686400 00000100:00100000:1.0:1788850995.125551:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788850995.125557:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019686400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125583:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019686400:12345-0@lo:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850995.125589:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788850995.125623:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019685888:0@lo:400:kworker.0 00010000:00080000:1.0:1788850995.125634:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e8a5e0380 x1875746019686400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850995.125643:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019686400:0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125651:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019686016:0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125658:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019686528:0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125691:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019685760:0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125714:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850995.125748:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019686272:0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125770:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850995.125785:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019686784:0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.125802:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788850995.125832:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88150000 x1875746019685248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850995.125845:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019685248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788850995.125856:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788850995.125862:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019685632:0@lo:400:kworker.0 00000100:00100000:0.0:1788850995.125883:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686272 00000100:00100000:0.0:1788850995.125888:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686272 00000100:00100000:0.0:1788850995.125917:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788850995.125923:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019686272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850995.125955:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019686272:12345-0@lo:400:kworker.0 Request processed in 34us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850995.125959:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1788850995.125985:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8813c380 x1875746019685376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850995.125996:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019685376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788850995.126036:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686784 00000100:00100000:0.0:1788850995.126039:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686784 00000100:00100000:0.0:1788850995.126061:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788850995.126084:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019686784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850995.126111:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019686784:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850995.126116:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788850995.126239:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685760 00000100:00100000:3.0:1788850995.126243:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685760 00000100:00100000:3.0:1788850995.126264:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788850995.126270:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019685760:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788850995.126272:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788850995.126283:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788850995.126287:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850995.126290:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788850995.126308:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019685760:12345-0@lo:400:kworker.0 Request processed in 37us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850995.126314:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788850995.126354:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788850995.126365:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019686912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850995.126395:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850995.126529:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850995.126555:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019686144:0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.126574:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850995.126592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019686656:0@lo:400:kworker.0 00000100:00100000:3.0:1788850995.126603:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686912 00000100:00100000:3.0:1788850995.126608:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686912 00000100:00100000:1.0:1788850995.126616:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850995.126638:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788850995.126644:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019685760:0@lo:400:kworker.0 00000100:00100000:3.0:1788850995.126648:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019686912:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788850995.126660:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e8a5e1c00 x1875746019686272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850995.126669:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019686272:0@lo:400:kworker.0 00010000:00080000:1.0:1788850995.126678:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1b800 x1875746019686784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850995.126686:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019686784:0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.126708:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685632 00000100:00100000:1.0:1788850995.126712:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685632 00002000:00000024:3.0:1788850995.126754:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850995.126789:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019686912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850995.126796:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788850995.126861:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686144 00000100:00100000:2.0:1788850995.126866:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686144 00000100:00100000:2.0:1788850995.126907:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686656 00000100:00100000:2.0:1788850995.126911:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686656 00000100:00100000:2.0:1788850995.126943:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788850995.126955:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019686144:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788850995.126972:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788850995.126977:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850995.126999:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019686144:12345-0@lo:400:kworker.0 Request processed in 48us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850995.127003:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019687040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788850995.127058:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788850995.127096:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd6680 x1875746019686912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850995.127110:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019686912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788850995.127133:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687040 00000100:00100000:3.0:1788850995.127136:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687040 00000100:00100000:3.0:1788850995.127158:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788850995.127164:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019687040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788850995.127174:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788850995.127204:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019687040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850995.127210:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788850995.127232:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8813c380 x1875746019687040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850995.127243:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019687040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788850995.130686:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788850995.130718:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019686656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850995.130813:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019686656:12345-0@lo:400:kworker.0 Request processed in 113us (4197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850995.130821:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788850995.130928:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019686144:0@lo:400:kworker.0 00010000:00080000:0.0:1788850995.130941:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a99500 x1875746019686656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850995.130950:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019686656:0@lo:400:kworker.0 00000100:00100000:2.0:1788850995.134857:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788850995.148241:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788850995.148266:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019685632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850995.149192:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019685632:12345-0@lo:400:kworker.0 Request processed in 934us (22657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850995.149206:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788850995.149388:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019685632:0@lo:400:kworker.0 00010000:00010000:0.0:1788850995.389402:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788850995.899396:0:11331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:3.0:1788850996.152206:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788850996.152243:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019687168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788850996.152340:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850996.152479:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687168 00000100:00100000:0.0:1788850996.152488:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687168 00000100:00100000:0.0:1788850996.152543:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788850996.152552:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019687168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788850996.152587:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788850996.152636:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019687168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850996.152643:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788850996.152909:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019687168:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788850996.405052:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850997.428187:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850997.495244:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850997.495696:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850997.495728:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788850997.495754:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742528 00000100:00100000:2.0:1788850997.495773:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742528 00000100:00100000:2.0:1788850997.495840:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742400 00000100:00100000:2.0:1788850997.495844:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742400 00000100:00100000:2.0:1788850997.495876:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:2.0:1788850997.495886:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000742528:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788850997.495964:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000742528:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850997.495982:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:2.0:1788850997.496001:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00100000:2.0:1788850997.496008:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000742400:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788850997.496056:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000742400:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 49us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850997.496062:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00080000:2.0:1788850997.496079:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788850997.496083:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788850997.505679:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742272 00000100:00100000:1.0:1788850997.505699:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742272 00000100:00100000:0.0:1788850997.506168:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 286 00000100:00100000:0.0:1788850997.506182:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2409:x1875746000742272:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788850997.506281:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2409:x1875746000742272:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 101us (11046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850997.506289:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 286 00000001:02000400:1.0:1788850997.867924:0:11379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 03:03:15 EDT 2026 00000100:00100000:1.0:1788850998.197671:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788850998.197707:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019687296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788850998.197780:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850998.198043:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687296 00000100:00100000:0.0:1788850998.198053:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687296 00000100:00100000:0.0:1788850998.198109:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788850998.198119:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019687296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788850998.198154:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788850998.198213:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019687296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850998.198221:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788850998.198304:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019687296:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788850998.453644:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850999.476209:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851000.249244:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019687424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851000.249328:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851000.249617:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019687680:0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.249654:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851000.249678:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019688192:0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.249700:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851000.249733:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019688704:0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.249753:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851000.249784:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788851000.249791:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019687808:0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.249823:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851000.249844:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019688320:0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.249862:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851000.249877:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019688832:0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.249896:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851000.249934:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687680 00000100:00100000:2.0:1788851000.249942:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687680 00000100:00100000:2.0:1788851000.249986:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688192 00000100:00100000:2.0:1788851000.249989:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688192 00000100:00100000:2.0:1788851000.250028:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688704 00000100:00100000:2.0:1788851000.250031:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688704 00000100:00100000:2.0:1788851000.250044:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688320 00000100:00100000:2.0:1788851000.250046:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688320 00000100:00100000:2.0:1788851000.250061:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788851000.250068:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019687680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.250118:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019687680:12345-0@lo:400:kworker.0 Request processed in 49us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851000.250124:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788851000.250142:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788851000.250148:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019688192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.250173:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019688192:12345-0@lo:400:kworker.0 Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851000.250179:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788851000.250191:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788851000.250198:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019688704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.250228:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019688704:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851000.250234:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788851000.250248:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788851000.250254:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019688320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.250281:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019688320:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851000.250295:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788851000.250318:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687808 00000100:00100000:2.0:1788851000.250322:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687808 00000100:00100000:2.0:1788851000.250341:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788851000.250347:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019687808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.250376:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019687808:12345-0@lo:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851000.250382:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788851000.250402:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851000.250406:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851000.250432:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019687808:0@lo:400:kworker.0 00010000:00080000:2.0:1788851000.250446:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a3b100 x1875746019688320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851000.250455:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019688320:0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.250464:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019687680:0@lo:400:kworker.0 00000100:00100000:2.0:1788851000.250471:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019688192:0@lo:400:kworker.0 00010000:00080000:2.0:1788851000.250480:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a3a300 x1875746019688704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851000.250488:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019688704:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.250742:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688832 00000100:00100000:1.0:1788851000.250746:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688832 00000100:00100000:1.0:1788851000.250806:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788851000.250815:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019688832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.250854:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019688832:12345-0@lo:400:kworker.0 Request processed in 42us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851000.250859:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788851000.250886:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019687936:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.250916:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851000.250936:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019688448:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.250956:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851000.250982:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019688960:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251036:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851000.251057:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788851000.251063:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019687552:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251091:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851000.251111:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019688064:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251130:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851000.251145:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019688576:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251162:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851000.251185:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688448 00000100:00100000:1.0:1788851000.251188:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688448 00000100:00100000:1.0:1788851000.251209:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688960 00000100:00100000:1.0:1788851000.251211:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688960 00000100:00100000:1.0:1788851000.251230:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788851000.251236:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019688448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251268:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019688448:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851000.251273:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788851000.251284:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788851000.251289:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019688960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251313:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019688960:12345-0@lo:400:kworker.0 Request processed in 24us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851000.251319:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788851000.251340:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687552 00000100:00100000:1.0:1788851000.251344:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687552 00000100:00100000:1.0:1788851000.251367:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788851000.251374:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019687552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251415:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019687552:12345-0@lo:400:kworker.0 Request processed in 41us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851000.251421:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788851000.251451:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687936 00000100:00100000:1.0:1788851000.251454:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687936 00000100:00100000:1.0:1788851000.251475:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688576 00000100:00100000:1.0:1788851000.251479:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688576 00000100:00100000:1.0:1788851000.251497:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788851000.251503:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019687936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251533:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019687936:12345-0@lo:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851000.251538:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788851000.251550:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788851000.251556:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019688576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251585:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019688576:12345-0@lo:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851000.251591:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788851000.251607:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688064 00000100:00100000:1.0:1788851000.251610:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688064 00000100:00100000:1.0:1788851000.251633:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788851000.251639:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019688064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251669:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019688064:12345-0@lo:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851000.251675:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1788851000.251712:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a3bb80 x1875746019688832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851000.251737:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019688832:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251766:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019687552:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251793:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019688064:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251802:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019688576:0@lo:400:kworker.0 00000100:00100000:1.0:1788851000.251811:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019687936:0@lo:400:kworker.0 00010000:00080000:1.0:1788851000.251820:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a3aa00 x1875746019688448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851000.251829:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019688448:0@lo:400:kworker.0 00010000:00080000:1.0:1788851000.251838:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a38700 x1875746019688960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851000.251847:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019688960:0@lo:400:kworker.0 00000100:00080000:2.0:1788851000.252599:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851000.252606:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851000.252608:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851000.253108:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687424 00000100:00100000:0.0:1788851000.253116:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687424 00000100:00100000:0.0:1788851000.253169:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788851000.253178:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019687424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851000.253205:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851000.253274:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019687424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851000.253280:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788851000.253507:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788851000.253691:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1b800 x1875746019687424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851000.253857:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019689088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851000.253894:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851000.253963:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689088 00000100:00100000:2.0:1788851000.253978:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689088 00000100:00100000:2.0:1788851000.254032:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788851000.254040:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019689088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851000.254060:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851000.254094:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019689088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851000.254100:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788851000.254123:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e85697800 x1875746019689088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851000.254137:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019689088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851000.254401:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019687424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851000.258280:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851000.258302:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019689216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851000.258370:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851000.258413:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689216 00000100:00100000:2.0:1788851000.258420:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689216 00000100:00100000:2.0:1788851000.258462:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788851000.258470:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019689216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851000.258492:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851000.258536:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019689216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851000.258543:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788851000.258581:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a3a300 x1875746019689216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851000.258599:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019689216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851000.261158:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851000.261180:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019689344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851000.261241:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851000.261309:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689344 00000100:00100000:1.0:1788851000.261317:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689344 00000100:00100000:1.0:1788851000.261361:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788851000.261369:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019689344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851000.261388:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851000.261426:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019689344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851000.261444:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788851000.261516:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e85697800 x1875746019689344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851000.261539:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019689344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788851000.503226:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851001.268430:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019689472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851001.268523:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851001.268723:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689472 00000100:00100000:0.0:1788851001.268731:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689472 00000100:00100000:0.0:1788851001.268790:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788851001.268799:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019689472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788851001.268832:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788851001.268880:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019689472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851001.268887:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788851001.268930:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019689472:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851001.525527:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851002.549510:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851002.611718:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851002.611911:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851002.612007:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742656 00000100:00100000:1.0:1788851002.612045:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742656 00000100:00100000:1.0:1788851002.612098:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 288 00000100:00100000:1.0:1788851002.612109:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2408:x1875746000742656:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851002.612187:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2408:x1875746000742656:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 79us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851002.612194:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 288 00000100:00100000:2.0:1788851002.612884:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851002.615449:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742912 00000100:00100000:3.0:1788851002.615464:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742912 00000100:00100000:1.0:1788851002.615490:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742784 00000100:00100000:1.0:1788851002.615494:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742784 00000100:00080000:2.0:1788851002.615541:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851002.615545:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851002.615546:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:1.0:1788851002.615555:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000742784:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851002.615604:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:3.0:1788851002.615612:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000742912:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851002.615633:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000742784:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 80us (2751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851002.615637:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000742912:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (3728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851002.615641:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:3.0:1788851002.615644:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:1.0:1788851003.316234:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851003.316258:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019689600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851003.316333:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851003.316510:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689600 00000100:00100000:2.0:1788851003.316520:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689600 00000100:00100000:2.0:1788851003.316576:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788851003.316586:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019689600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788851003.316628:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788851003.316698:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019689600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851003.316705:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788851003.316798:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019689600:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788851003.573296:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851004.601492:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851005.364166:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851005.364191:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019689728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851005.364268:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851005.364337:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689728 00000100:00100000:1.0:1788851005.364345:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689728 00000100:00100000:1.0:1788851005.364407:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788851005.364443:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019689728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851005.364482:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851005.364527:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019689728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851005.364534:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788851005.364556:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788851005.364587:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1b800 x1875746019689728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851005.366035:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019689728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851005.366065:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019689856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851005.366113:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851005.366132:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019690368:0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366150:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851005.366164:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019690880:0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366180:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851005.366192:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019691392:0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366205:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851005.366217:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788851005.366222:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019690240:0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366239:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851005.366252:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019690752:0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366267:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851005.366278:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019691264:0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366292:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851005.366345:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690368 00000100:00100000:1.0:1788851005.366351:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690368 00000100:00100000:1.0:1788851005.366391:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690752 00000100:00100000:1.0:1788851005.366395:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690752 00000100:00100000:1.0:1788851005.366423:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788851005.366431:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019690368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366477:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019690368:12345-0@lo:400:kworker.0 Request processed in 47us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851005.366484:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788851005.366499:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788851005.366505:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019690752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366530:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019690752:12345-0@lo:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851005.366536:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788851005.366553:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690880 00000100:00100000:1.0:1788851005.366557:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690880 00000100:00100000:1.0:1788851005.366583:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691392 00000100:00100000:1.0:1788851005.366586:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691392 00000100:00100000:1.0:1788851005.366596:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691264 00000100:00100000:1.0:1788851005.366598:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691264 00000100:00100000:1.0:1788851005.366630:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851005.366637:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019690880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366669:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019690880:12345-0@lo:400:kworker.0 Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851005.366685:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851005.366769:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851005.366782:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019691392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366810:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019691392:12345-0@lo:400:kworker.0 Request processed in 31us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851005.366822:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788851005.366832:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689856 00000100:00100000:1.0:1788851005.366834:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788851005.366837:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689856 00000100:00100000:1.0:1788851005.366839:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019691264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.366869:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019691264:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851005.366874:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788851005.366876:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788851005.366882:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019689856:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851005.366893:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690240 00000100:00100000:1.0:1788851005.366896:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690240 00002000:00000024:0.0:1788851005.366913:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851005.366917:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788851005.366923:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019690240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851005.366944:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019689856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851005.366949:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019690240:12345-0@lo:400:kworker.0 Request processed in 27us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851005.366951:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788851005.366954:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788851005.366989:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851005.366992:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851005.366994:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851005.367037:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019690240:0@lo:400:kworker.0 00010000:00080000:1.0:1788851005.367050:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8ce00 x1875746019690752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851005.367059:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019690752:0@lo:400:kworker.0 00010000:00080000:1.0:1788851005.367069:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8f480 x1875746019691264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851005.367077:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019691264:0@lo:400:kworker.0 00010000:00080000:1.0:1788851005.367086:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a3ad80 x1875746019689856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851005.367110:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019689856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851005.367122:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019690368:0@lo:400:kworker.0 00010000:00080000:1.0:1788851005.367131:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8df80 x1875746019690880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851005.367139:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019690880:0@lo:400:kworker.0 00010000:00080000:1.0:1788851005.367147:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8d180 x1875746019691392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851005.367154:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019691392:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.369392:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019689984:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.369466:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851005.369507:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019690496:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.369531:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851005.369594:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019691008:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.369629:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851005.369654:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019691520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851005.369688:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851005.369725:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788851005.369732:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019690112:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.369753:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851005.369771:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019690624:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.369790:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851005.369807:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019691136:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.369825:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851005.369861:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019691648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851005.369882:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851005.369917:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691008 00000100:00100000:3.0:1788851005.369925:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691008 00000100:00100000:3.0:1788851005.369975:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690112 00000100:00100000:3.0:1788851005.369977:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690112 00000100:00100000:3.0:1788851005.369991:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690624 00000100:00100000:3.0:1788851005.369993:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690624 00000100:00100000:3.0:1788851005.370005:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691136 00000100:00100000:3.0:1788851005.370007:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691136 00000100:00100000:3.0:1788851005.370054:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788851005.370063:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019691008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.370115:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019691008:12345-0@lo:400:kworker.0 Request processed in 52us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851005.370122:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788851005.370138:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788851005.370144:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019690112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.370172:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019690112:12345-0@lo:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851005.370178:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788851005.370189:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788851005.370194:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019690624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.370219:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019690624:12345-0@lo:400:kworker.0 Request processed in 25us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851005.370225:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788851005.370234:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788851005.370239:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019691136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.370276:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019691136:12345-0@lo:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851005.370283:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788851005.370318:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019690112:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.370329:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019690624:0@lo:400:kworker.0 00010000:00080000:3.0:1788851005.370339:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8d880 x1875746019691136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851005.370349:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019691136:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.370358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019691008:0@lo:400:kworker.0 00000100:00100000:3.0:1788851005.370387:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691520 00000100:00100000:3.0:1788851005.370391:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691520 00000100:00100000:3.0:1788851005.370408:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691648 00000100:00100000:3.0:1788851005.370410:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691648 00000100:00100000:3.0:1788851005.370423:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788851005.370429:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019691520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788851005.370446:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851005.370501:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019691520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851005.370508:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788851005.370520:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788851005.370526:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019691648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851005.370536:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851005.370561:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019691648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851005.370576:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788851005.370608:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca2680 x1875746019691648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851005.370624:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019691648:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788851005.370634:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c36d80 x1875746019691520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851005.370644:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019691520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851005.370933:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689984 00000100:00100000:0.0:1788851005.370938:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689984 00000100:00100000:0.0:1788851005.370978:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788851005.370985:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019689984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851005.371046:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019689984:12345-0@lo:400:kworker.0 Request processed in 61us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851005.371061:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788851005.371332:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019689984:0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.374788:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690496 00000100:00100000:1.0:1788851005.374803:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690496 00000100:00100000:1.0:1788851005.374865:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788851005.374874:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019690496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851005.374979:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019690496:12345-0@lo:400:kworker.0 Request processed in 106us (5446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851005.374987:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788851005.375039:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851005.375045:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851005.375081:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019690496:0@lo:400:kworker.0 00010000:00010000:2.0:1788851005.628975:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851006.388256:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851006.388283:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019691776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851006.388373:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851006.391959:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691776 00000100:00100000:2.0:1788851006.391977:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691776 00000100:00100000:2.0:1788851006.392087:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788851006.392098:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019691776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851006.392138:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788851006.392234:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019691776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (3860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851006.392241:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788851006.392833:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019691776:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851006.645181:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851007.669225:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851007.738789:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851007.738831:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851007.738856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851007.738882:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743168 00000100:00100000:3.0:1788851007.738894:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743168 00000100:00100000:3.0:1788851007.738951:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743296 00000100:00100000:3.0:1788851007.738955:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743296 00000100:00100000:3.0:1788851007.738979:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:3.0:1788851007.738988:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000743168:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851007.739083:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000743168:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 96us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851007.739090:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:3.0:1788851007.739107:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:3.0:1788851007.739113:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000743296:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851007.739137:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000743296:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851007.739151:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:3.0:1788851007.739169:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743040 00000100:00100000:3.0:1788851007.739172:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743040 00000100:00100000:3.0:1788851007.739197:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 290 00000100:00100000:3.0:1788851007.739203:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2409:x1875746000743040:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851007.739231:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2409:x1875746000743040:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851007.739237:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 290 00000100:00080000:3.0:1788851007.739265:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788851007.739268:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851008.436687:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019691904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851008.436767:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851008.436837:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691904 00000100:00100000:1.0:1788851008.436845:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691904 00000100:00100000:1.0:1788851008.436891:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788851008.436900:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e92ebb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019691904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851008.436935:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788851008.436982:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e92ebb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019691904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851008.436989:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788851008.437302:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019691904:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788851008.692200:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851009.720706:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851010.484390:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019692288:0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.484466:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.484525:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019692800:0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.484566:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.484603:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019693312:0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.484625:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.484656:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788851010.484662:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019692416:0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.484683:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.484699:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019692928:0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.484722:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.484744:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019693440:0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.484795:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.484831:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692288 00000100:00100000:0.0:1788851010.484839:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692288 00000100:00100000:0.0:1788851010.484887:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788851010.484895:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019692288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.484948:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019692288:12345-0@lo:400:kworker.0 Request processed in 53us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.484956:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788851010.484978:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692800 00000100:00100000:0.0:1788851010.484981:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692800 00000100:00100000:0.0:1788851010.485043:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693312 00000100:00100000:0.0:1788851010.485054:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693312 00000100:00100000:0.0:1788851010.485081:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692416 00000100:00100000:0.0:1788851010.485084:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692416 00000100:00100000:0.0:1788851010.485099:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788851010.485106:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019692800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.485139:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019692800:12345-0@lo:400:kworker.0 Request processed in 34us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.485146:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788851010.485159:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788851010.485165:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019693312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.485193:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019693312:12345-0@lo:400:kworker.0 Request processed in 29us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.485199:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788851010.485211:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788851010.485218:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019692416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.485244:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019692416:12345-0@lo:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.485250:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788851010.485269:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692928 00000100:00100000:0.0:1788851010.485272:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692928 00000100:00100000:0.0:1788851010.485298:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693440 00000100:00100000:0.0:1788851010.485301:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693440 00000100:00100000:0.0:1788851010.485320:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788851010.485327:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019692928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.485358:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019692928:12345-0@lo:400:kworker.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.485364:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788851010.485385:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788851010.485391:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019693440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.485421:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019693440:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.485426:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788851010.485475:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019692416:0@lo:400:kworker.0 00010000:00080000:0.0:1788851010.485487:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8c380 x1875746019692928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851010.485497:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019692928:0@lo:400:kworker.0 00010000:00080000:0.0:1788851010.485505:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8f100 x1875746019693440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851010.485514:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019693440:0@lo:400:kworker.0 00000100:00100000:0.0:1788851010.485523:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019692288:0@lo:400:kworker.0 00010000:00080000:0.0:1788851010.485531:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8d500 x1875746019692800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851010.485538:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019692800:0@lo:400:kworker.0 00010000:00080000:0.0:1788851010.485547:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8ca80 x1875746019693312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851010.485555:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019693312:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486373:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019692032:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486424:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851010.486456:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019692544:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486480:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851010.486499:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019693056:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486520:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851010.486536:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019693568:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486555:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851010.486584:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788851010.486591:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019692160:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486613:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851010.486631:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019692672:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486650:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851010.486661:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019693184:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486695:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851010.486752:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692032 00000100:00100000:1.0:1788851010.486758:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692032 00000100:00100000:1.0:1788851010.486801:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788851010.486809:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019692032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486847:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019692032:12345-0@lo:400:kworker.0 Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851010.486853:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788851010.486882:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693056 00000100:00100000:1.0:1788851010.486886:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693056 00000100:00100000:1.0:1788851010.486910:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693568 00000100:00100000:1.0:1788851010.486913:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693568 00000100:00100000:1.0:1788851010.486931:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788851010.486937:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019693056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.486967:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019693056:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851010.486973:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788851010.486984:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788851010.486989:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019693568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487033:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019693568:12345-0@lo:400:kworker.0 Request processed in 44us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851010.487039:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788851010.487060:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692544 00000100:00100000:1.0:1788851010.487064:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692544 00000100:00100000:1.0:1788851010.487087:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788851010.487093:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019692544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487123:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019692544:12345-0@lo:400:kworker.0 Request processed in 30us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851010.487137:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788851010.487158:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692160 00000100:00100000:1.0:1788851010.487162:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692160 00000100:00100000:1.0:1788851010.487178:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692672 00000100:00100000:1.0:1788851010.487180:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692672 00000100:00100000:1.0:1788851010.487192:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693184 00000100:00100000:1.0:1788851010.487194:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693184 00000100:00100000:1.0:1788851010.487209:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788851010.487215:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019692160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487242:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019692160:12345-0@lo:400:kworker.0 Request processed in 27us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851010.487248:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788851010.487258:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788851010.487264:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019692672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487287:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019692672:12345-0@lo:400:kworker.0 Request processed in 24us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851010.487292:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788851010.487301:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788851010.487306:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019693184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487328:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019693184:12345-0@lo:400:kworker.0 Request processed in 22us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851010.487333:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788851010.487366:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019692160:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487376:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019692672:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487384:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019693184:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487400:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019692032:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487408:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019692544:0@lo:400:kworker.0 00010000:00080000:1.0:1788851010.487419:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8dc00 x1875746019693056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851010.487429:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019693056:0@lo:400:kworker.0 00010000:00080000:1.0:1788851010.487438:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8ed80 x1875746019693568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851010.487445:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019693568:0@lo:400:kworker.0 00000100:00100000:1.0:1788851010.487479:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851010.487485:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019693696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851010.487511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851010.487540:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693696 00000100:00100000:1.0:1788851010.487544:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693696 00000100:00100000:1.0:1788851010.487568:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788851010.487591:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019693696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851010.487614:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851010.487647:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019693696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851010.487653:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788851010.487679:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1bb80 x1875746019693696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851010.487692:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019693696:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788851010.487746:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851010.487757:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851010.487759:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851010.487761:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851010.488212:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851010.488223:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019693824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851010.488254:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.488290:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693824 00000100:00100000:0.0:1788851010.488293:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693824 00000100:00100000:0.0:1788851010.488321:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788851010.488327:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019693824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851010.488344:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851010.488375:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019693824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.488380:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788851010.488405:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c33100 x1875746019693824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851010.488418:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019693824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851010.491063:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851010.491081:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019693952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851010.491144:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.491187:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693952 00000100:00100000:0.0:1788851010.491194:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693952 00000100:00100000:0.0:1788851010.491236:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788851010.491245:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019693952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851010.491263:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851010.491305:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019693952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.491311:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1788851010.491351:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c33100 x1875746019693952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851010.491368:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019693952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851010.496950:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019694080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851010.497041:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.509712:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694080 00000100:00100000:0.0:1788851010.509736:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694080 00000100:00100000:0.0:1788851010.509808:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788851010.509819:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019694080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788851010.509845:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851010.509933:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019694080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (12891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.509941:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788851010.510739:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b74e00 x1875746019694080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851010.510759:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019694080:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788851010.740635:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851011.509170:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019694208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851011.509280:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851011.512132:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694208 00000100:00100000:0.0:1788851011.512146:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694208 00000100:00100000:0.0:1788851011.512246:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788851011.512256:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019694208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788851011.512295:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788851011.512409:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019694208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851011.512417:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788851011.512594:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019694208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788851011.765772:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851012.790068:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788851012.828145:0:12009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:03:30 (1788851010) === 00000100:00100000:0.0:1788851012.867121:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851012.867164:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851012.867191:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851012.867224:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743424 00000100:00100000:0.0:1788851012.867236:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743424 00000100:00100000:0.0:1788851012.867293:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 292 00000100:00100000:0.0:1788851012.867303:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000743424:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851012.867381:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2407:x1875746000743424:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851012.867389:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 292 00000100:00100000:0.0:1788851012.867424:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743680 00000100:00100000:0.0:1788851012.867428:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743680 00000100:00100000:0.0:1788851012.867485:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743552 00000100:00100000:0.0:1788851012.867488:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743552 00000100:00100000:0.0:1788851012.867509:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:0.0:1788851012.867515:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000743680:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851012.867560:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000743680:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 45us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851012.867566:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:0.0:1788851012.867579:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:0.0:1788851012.867585:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000743552:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851012.867611:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000743552:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851012.867618:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00080000:2.0:1788851012.868211:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851012.868216:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851013.191478:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851013.191708:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743808 00000100:00100000:1.0:1788851013.191720:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743808 00000100:00100000:1.0:1788851013.191780:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 293 00000100:00100000:1.0:1788851013.191790:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:8765:x1875746000743808:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788851013.191807:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851013.191825:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94400/0x3e0030720b205a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3895c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851013.191854:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94400/0x3e0030720b205a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3895c expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851013.191867:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94400/0x3e0030720b205a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3895c expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851013.191876:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94400, rc 0) 00000100:00100000:1.0:1788851013.191950:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8765:x1875746000743808:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 161us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.191958:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 293 00000100:00100000:0.0:1788851013.199394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851013.199786:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743936 00000100:00100000:1.0:1788851013.199797:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743936 00000100:00100000:1.0:1788851013.199854:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 294 00000100:00100000:1.0:1788851013.199864:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8765:x1875746000743936:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788851013.200069:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8765:x1875746000743936:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 206us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.200077:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 294 00000100:00100000:2.0:1788851013.205089:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851013.208827:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744064 00000100:00100000:0.0:1788851013.208846:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744064 00000100:00100000:0.0:1788851013.208925:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:0.0:1788851013.208937:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8765:x1875746000744064:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788851013.209445:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8765:x1875746000744064:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 508us (4363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851013.209454:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 295 00000100:00100000:2.0:1788851013.215731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851013.215821:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744192 00000100:00100000:3.0:1788851013.215833:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744192 00000100:00100000:3.0:1788851013.215890:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 296 00000100:00100000:3.0:1788851013.215900:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8769:x1875746000744192:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788851013.216090:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8769:x1875746000744192:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 190us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851013.216098:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 296 00000100:00100000:3.0:1788851013.243506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851013.245001:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744320 00000100:00100000:0.0:1788851013.245042:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744320 00000100:00100000:0.0:1788851013.245123:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00100000:0.0:1788851013.245134:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8769:x1875746000744320:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788851013.245295:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8769:x1875746000744320:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 162us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851013.245311:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 297 00000100:00100000:0.0:1788851013.249280:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851013.250181:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744448 00000100:00100000:1.0:1788851013.250192:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744448 00000100:00100000:1.0:1788851013.250254:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:1.0:1788851013.250265:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8769:x1875746000744448:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851013.250641:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8769:x1875746000744448:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 375us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.250650:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:2.0:1788851013.257306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851013.257396:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744576 00000100:00100000:3.0:1788851013.257405:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744576 00000100:00100000:3.0:1788851013.257584:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 299 00000100:00100000:3.0:1788851013.257596:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:8765:x1875746000744576:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788851013.257614:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851013.257631:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031800/0x3e0030720b205a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3898d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851013.257678:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031800/0x3e0030720b205a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3898d expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851013.257690:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031800/0x3e0030720b205a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3898d expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851013.257699:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031800, rc 0) 00000100:00100000:3.0:1788851013.257794:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:8765:x1875746000744576:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 200us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851013.257801:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 299 00000100:00100000:0.0:1788851013.262595:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851013.262674:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744704 00000100:00100000:1.0:1788851013.262686:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744704 00000100:00100000:1.0:1788851013.262742:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 300 00000100:00100000:1.0:1788851013.262752:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:8765:x1875746000744704:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788851013.262781:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788851013.262807:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788851013.262811:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788851013.262814:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788851013.262816:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788851013.262819:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788851013.264080:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:8765:x1875746000744704:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 1322us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.264092:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 300 00000100:00100000:2.0:1788851013.268944:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851013.269081:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744832 00000100:00100000:3.0:1788851013.269092:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744832 00000100:00100000:3.0:1788851013.269136:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 301 00000100:00100000:3.0:1788851013.269145:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:8765:x1875746000744832:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788851013.269164:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851013.269192:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38994 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851013.269219:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38994 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851013.269230:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38994 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851013.269239:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031a00, rc 0) 00000100:00100000:3.0:1788851013.269325:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:8765:x1875746000744832:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 180us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851013.269331:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 301 00000100:00100000:0.0:1788851013.272869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851013.273213:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744960 00000100:00100000:1.0:1788851013.273224:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744960 00000100:00100000:1.0:1788851013.273284:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 302 00000100:00100000:1.0:1788851013.273295:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:8765:x1875746000744960:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788851013.273464:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:8765:x1875746000744960:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 170us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.273489:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 302 00000100:00100000:2.0:1788851013.276432:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851013.279790:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745088 00000100:00100000:0.0:1788851013.279807:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745088 00000100:00100000:0.0:1788851013.279882:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 303 00000100:00100000:0.0:1788851013.279894:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:8765:x1875746000745088:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788851013.280136:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:8765:x1875746000745088:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 243us (3713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851013.280145:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 303 00000100:00100000:2.0:1788851013.286904:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851013.291398:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745216 00000100:00100000:3.0:1788851013.291418:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745216 00000100:00100000:3.0:1788851013.291509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 304 00000100:00100000:3.0:1788851013.291533:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:8773:x1875746000745216:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788851013.291720:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:8773:x1875746000745216:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 201us (4824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851013.291729:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 304 00000100:00100000:3.0:1788851013.296738:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851013.296958:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745344 00000100:00100000:1.0:1788851013.296968:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745344 00000100:00100000:1.0:1788851013.297063:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 305 00000100:00100000:1.0:1788851013.297074:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:8773:x1875746000745344:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851013.297241:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:8773:x1875746000745344:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 167us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.297250:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 305 00000100:00100000:2.0:1788851013.309947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851013.310059:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851013.310274:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745472 00000100:00100000:0.0:1788851013.310284:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745472 00000100:00100000:0.0:1788851013.310336:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745728 00000100:00100000:0.0:1788851013.310339:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745728 00000100:00100000:0.0:1788851013.310368:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1788851013.310376:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1875746000745472:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788851013.310409:0:10526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f4c53046-d9be-47e4-bc50-30ccb352d04d@192.168.204.27@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:0.0:1788851013.310461:0:10526:0:(genops.c:1384:class_connect()) connect: client f4c53046-d9be-47e4-bc50-30ccb352d04d, cookie 0x3e0030720b205a2b 00000004:00100000:0.0:1788851013.310488:0:10526:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788851013.310797:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1788851013.310804:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875746000745728:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788851013.310822:0:6534:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from f4c53046-d9be-47e4-bc50-30ccb352d04d@192.168.204.27@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:3.0:1788851013.310844:0:6534:0:(genops.c:1384:class_connect()) connect: client f4c53046-d9be-47e4-bc50-30ccb352d04d, cookie 0x3e0030720b205a32 00000004:00100000:3.0:1788851013.310856:0:6534:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788851013.310988:0:6534:0:(import.c:65:import_set_state_nolock()) ffff892d879dd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851013.311093:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2406:x1875746000745728:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 287us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851013.311102:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00080000:0.0:1788851013.311321:0:10526:0:(import.c:65:import_set_state_nolock()) ffff892ea5a1b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851013.311352:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2406:x1875746000745472:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 975us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851013.311359:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:2.0:1788851013.325999:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851013.326077:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851013.326155:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851013.326356:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745984 00000100:00100000:0.0:1788851013.326378:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745984 00000100:00100000:0.0:1788851013.326462:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745600 00000100:00100000:0.0:1788851013.326466:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745600 00000100:00100000:0.0:1788851013.326484:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745856 00000100:00100000:0.0:1788851013.326487:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745856 00000100:00100000:0.0:1788851013.326509:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00080000:2.0:1788851013.326639:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851013.326655:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851013.326782:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+7:8765:x1875746000745984:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788851013.326827:0:9543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788851013.326919:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+7:8765:x1875746000745984:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 401us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851013.326927:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1788851013.326944:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1788851013.326951:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:0:x1875746000745600:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788851013.326963:0:9543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788851013.326987:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:0:x1875746000745600:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 37us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851013.326994:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1788851013.327007:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1788851013.327038:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:0:x1875746000745856:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788851013.327056:0:9543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788851013.327093:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:0:x1875746000745856:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 56us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851013.327099:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1788851013.334446:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851013.334632:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746112 00000100:00100000:1.0:1788851013.334643:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746112 00000100:00100000:1.0:1788851013.334717:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1788851013.334728:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:8765:x1875746000746112:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788851013.334821:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:8765:x1875746000746112:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 94us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.334828:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1788851013.339126:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851013.339226:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746240 00000100:00100000:1.0:1788851013.339239:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746240 00000100:00100000:1.0:1788851013.339288:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1788851013.339296:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1875746000746240:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788851013.339334:0:8449:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f4c53046-d9be-47e4-bc50-30ccb352d04d@192.168.204.27@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:1.0:1788851013.339370:0:8449:0:(genops.c:1384:class_connect()) connect: client f4c53046-d9be-47e4-bc50-30ccb352d04d, cookie 0x3e0030720b205a39 00002000:00100000:1.0:1788851013.339383:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f4c53046-d9be-47e4-bc50-30ccb352d04d/ffff892d876bf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788851013.339402:0:8449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788851013.339489:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788851013.339615:0:8449:0:(import.c:65:import_set_state_nolock()) ffff892d876bd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851013.339747:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2406:x1875746000746240:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 449us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.339756:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1788851013.341651:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851013.341751:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851013.341852:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746368 00000100:00100000:1.0:1788851013.341859:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746368 00000100:00100000:1.0:1788851013.341940:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1788851013.341947:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875746000746368:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788851013.341978:0:8450:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f4c53046-d9be-47e4-bc50-30ccb352d04d@192.168.204.27@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:1.0:1788851013.342006:0:8450:0:(genops.c:1384:class_connect()) connect: client f4c53046-d9be-47e4-bc50-30ccb352d04d, cookie 0x3e0030720b205a40 00002000:00100000:1.0:1788851013.342038:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f4c53046-d9be-47e4-bc50-30ccb352d04d/ffff892d876bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788851013.342056:0:8450:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788851013.342125:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788851013.342152:0:8450:0:(import.c:65:import_set_state_nolock()) ffff892d876bd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851013.342211:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2406:x1875746000746368:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 263us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.342219:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1788851013.345649:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746496 00000100:00100000:3.0:1788851013.345668:0:6545:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746496 00000100:00100000:1.0:1788851013.347983:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1788851013.347998:0:6545:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:8765:x1875746000746496:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788851013.348127:0:6545:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:8765:x1875746000746496:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 133us (6375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851013.348136:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1788851013.351937:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851013.352191:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746624 00000100:00100000:2.0:1788851013.352205:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746624 00000100:00100000:2.0:1788851013.352267:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:2.0:1788851013.352277:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:8765:x1875746000746624:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788851013.352370:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788851013.352529:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:8765:x1875746000746624:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 239us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851013.352538:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:3.0:1788851013.558148:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851013.558178:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019694336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851013.558247:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851013.558581:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694336 00000100:00100000:2.0:1788851013.558590:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694336 00000100:00100000:2.0:1788851013.558643:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788851013.558653:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019694336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788851013.558696:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788851013.558750:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019694336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851013.558757:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788851013.559000:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019694336:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788851013.812418:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851014.836171:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851015.604786:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019694464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851015.604926:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.604977:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019694976:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605002:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605040:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019695488:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605063:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605084:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019696000:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605103:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605127:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788851015.605133:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019694848:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605155:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605175:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019695360:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605194:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605208:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019695872:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605226:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605255:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019694720:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605295:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605311:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019695232:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605330:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605345:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019695744:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605362:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605373:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788851015.605379:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019694592:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605404:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605426:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019695104:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605457:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605483:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019695616:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605518:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605537:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019696128:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605556:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851015.605589:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694464 00000100:00100000:0.0:1788851015.605596:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694464 00000100:00100000:0.0:1788851015.605649:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788851015.605658:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019694464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851015.605690:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851015.605728:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019694464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.605736:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788851015.605756:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694976 00000100:00100000:0.0:1788851015.605760:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694976 00000100:00100000:0.0:1788851015.605775:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695360 00000100:00100000:0.0:1788851015.605777:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695360 00000100:00100000:0.0:1788851015.605790:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695872 00000100:00100000:0.0:1788851015.605792:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695872 00000100:00100000:0.0:1788851015.605802:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694720 00000100:00100000:0.0:1788851015.605804:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694720 00000100:00100000:0.0:1788851015.605813:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695232 00000100:00100000:0.0:1788851015.605815:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695232 00000100:00100000:0.0:1788851015.605826:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695744 00000100:00100000:0.0:1788851015.605828:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695744 00000100:00100000:0.0:1788851015.605840:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788851015.605845:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019694976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605875:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019694976:12345-0@lo:400:kworker.0 Request processed in 30us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.605888:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788851015.605901:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788851015.605908:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019695360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605938:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019695360:12345-0@lo:400:kworker.0 Request processed in 31us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.605943:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788851015.605955:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788851015.605961:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019695872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.605986:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019695872:12345-0@lo:400:kworker.0 Request processed in 26us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.605992:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788851015.606003:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788851015.606031:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019694720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606061:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019694720:12345-0@lo:400:kworker.0 Request processed in 53us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606067:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788851015.606080:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788851015.606085:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019695232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606112:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019695232:12345-0@lo:400:kworker.0 Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606117:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788851015.606127:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788851015.606133:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019695744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606156:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019695744:12345-0@lo:400:kworker.0 Request processed in 24us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606169:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788851015.606189:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695488 00000100:00100000:0.0:1788851015.606192:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695488 00000100:00100000:0.0:1788851015.606211:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696000 00000100:00100000:0.0:1788851015.606214:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696000 00000100:00100000:0.0:1788851015.606224:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695616 00000100:00100000:0.0:1788851015.606227:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695616 00000100:00100000:0.0:1788851015.606237:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696128 00000100:00100000:0.0:1788851015.606240:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696128 00000100:00100000:0.0:1788851015.606251:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788851015.606256:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019695488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606286:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019695488:12345-0@lo:400:kworker.0 Request processed in 30us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606292:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788851015.606303:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788851015.606308:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019696000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606332:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019696000:12345-0@lo:400:kworker.0 Request processed in 25us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606338:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788851015.606348:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788851015.606354:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019695616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606380:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019695616:12345-0@lo:400:kworker.0 Request processed in 27us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606386:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788851015.606397:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788851015.606403:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019696128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606439:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019696128:12345-0@lo:400:kworker.0 Request processed in 38us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606446:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788851015.606463:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694848 00000100:00100000:0.0:1788851015.606467:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694848 00000100:00100000:0.0:1788851015.606497:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695104 00000100:00100000:0.0:1788851015.606501:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695104 00000100:00100000:0.0:1788851015.606511:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788851015.606516:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019694848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606547:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019694848:12345-0@lo:400:kworker.0 Request processed in 30us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606553:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788851015.606564:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788851015.606569:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019695104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606596:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019695104:12345-0@lo:400:kworker.0 Request processed in 27us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606601:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788851015.606626:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694592 00000100:00100000:0.0:1788851015.606630:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694592 00000100:00100000:0.0:1788851015.606653:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788851015.606659:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019694592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606686:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019694592:12345-0@lo:400:kworker.0 Request processed in 27us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851015.606692:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:0.0:1788851015.606726:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851015.606731:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851015.606733:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851015.606741:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851015.606776:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019694592:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606789:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019695104:0@lo:400:kworker.0 00010000:00080000:0.0:1788851015.606800:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c31880 x1875746019695616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851015.606812:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019695616:0@lo:400:kworker.0 00010000:00080000:0.0:1788851015.606821:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8dc00 x1875746019696128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851015.606829:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019696128:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606839:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019694720:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606848:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019695232:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606857:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019695744:0@lo:400:kworker.0 00000100:00100000:0.0:1788851015.606899:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019694848:0@lo:400:kworker.0 00010000:00080000:0.0:1788851015.606910:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c31f80 x1875746019695360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851015.606918:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019695360:0@lo:400:kworker.0 00010000:00080000:0.0:1788851015.606929:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c33100 x1875746019695872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851015.606937:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019695872:0@lo:400:kworker.0 00010000:00080000:0.0:1788851015.606945:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c33800 x1875746019694464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851015.606973:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019694464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851015.606986:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019694976:0@lo:400:kworker.0 00010000:00080000:0.0:1788851015.606997:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c32d80 x1875746019695488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851015.607005:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019695488:0@lo:400:kworker.0 00010000:00080000:0.0:1788851015.607039:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8ed80 x1875746019696000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851015.607047:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019696000:0@lo:400:kworker.0 00000100:00100000:1.0:1788851015.607344:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851015.607355:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019696256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851015.607400:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851015.607456:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696256 00000100:00100000:1.0:1788851015.607460:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696256 00000100:00100000:1.0:1788851015.607511:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788851015.607519:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019696256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851015.607533:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851015.607569:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019696256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851015.607575:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788851015.607603:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e19500 x1875746019696256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851015.607614:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019696256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851015.607987:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851015.607997:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019696384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851015.608051:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851015.608531:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696384 00000100:00100000:1.0:1788851015.608539:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696384 00000100:00100000:1.0:1788851015.608579:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788851015.608587:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019696384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851015.608608:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851015.608650:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019696384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851015.608656:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788851015.608687:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a3a300 x1875746019696384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851015.608701:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019696384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851015.610207:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019696512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851015.610263:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851015.610368:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696512 00000100:00100000:1.0:1788851015.610375:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696512 00000100:00100000:1.0:1788851015.610446:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851015.610454:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019696512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851015.610482:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851015.615608:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019696512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5147us (5337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851015.615624:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788851015.620684:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879e6680 x1875746019696512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851015.620713:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019696512:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788851015.860235:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851016.630132:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019696640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851016.630219:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851016.630340:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696640 00000100:00100000:3.0:1788851016.630348:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696640 00000100:00100000:3.0:1788851016.630403:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788851016.630413:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019696640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851016.630446:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851016.630715:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019696640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 303us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851016.630724:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788851016.632380:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019696640:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788851016.884179:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851017.908600:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851018.483779:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851018.483826:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851018.483864:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851018.483889:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851018.483909:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851018.483927:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851018.483949:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851018.483979:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747008 00000100:00100000:3.0:1788851018.483997:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747008 00000100:00100000:3.0:1788851018.484078:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747264 00000100:00100000:3.0:1788851018.484082:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747264 00000100:00100000:3.0:1788851018.484098:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746880 00000100:00100000:3.0:1788851018.484100:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746880 00000100:00100000:3.0:1788851018.484112:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747136 00000100:00100000:3.0:1788851018.484114:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747136 00000100:00100000:3.0:1788851018.484131:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:3.0:1788851018.484141:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000747008:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851018.484241:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000747008:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 101us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851018.484249:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:3.0:1788851018.484267:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:3.0:1788851018.484273:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2409:x1875746000747264:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851018.484304:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2409:x1875746000747264:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851018.484310:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:3.0:1788851018.484322:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:3.0:1788851018.484328:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000746880:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851018.484494:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746752 00000100:00100000:1.0:1788851018.484499:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746752 00000100:00100000:1.0:1788851018.484531:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:1.0:1788851018.484538:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000746752:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851018.484565:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000746752:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851018.484570:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:1.0:1788851018.484603:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:1.0:1788851018.484610:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2409:x1875746000747136:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851018.484634:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2409:x1875746000747136:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851018.484640:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:3.0:1788851018.485545:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000746880:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851018.485554:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:3.0:1788851018.485587:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747520 00000100:00100000:3.0:1788851018.485592:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747520 00000100:00100000:3.0:1788851018.485636:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747392 00000100:00100000:3.0:1788851018.485639:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747392 00000100:00100000:3.0:1788851018.485661:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1788851018.485678:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2409:x1875746000747520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851018.485723:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2409:x1875746000747520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 47us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851018.485730:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1788851018.485742:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:3.0:1788851018.485748:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2409:x1875746000747392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851018.485771:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2409:x1875746000747392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851018.485777:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00080000:3.0:1788851018.485800:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851018.485805:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851018.485807:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851018.485809:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851018.677932:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851018.677959:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019696768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851018.678063:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851018.678129:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696768 00000100:00100000:2.0:1788851018.678138:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696768 00000100:00100000:2.0:1788851018.678186:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788851018.678195:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019696768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788851018.678244:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788851018.678304:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019696768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851018.678310:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788851018.678359:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019696768:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788851018.679992:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4c53046-d9be-47e4-bc50-30ccb352d04d 00000001:00100000:2.0:1788851018.682167:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f4c53046-d9be-47e4-bc50-30ccb352d04d 00000001:00100000:3.0:1788851018.692959:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4c53046-d9be-47e4-bc50-30ccb352d04d 00000001:00100000:2.0:1788851018.700994:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4c53046-d9be-47e4-bc50-30ccb352d04d 00000001:02000400:2.0:1788851018.850628:0:12203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788851018.943633:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851019.963225:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851020.724285:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019697152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851020.724383:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851020.724514:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019697024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851020.724550:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697152 00000100:00100000:3.0:1788851020.724551:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851020.724560:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697152 00000100:00100000:3.0:1788851020.724588:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851020.724595:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019696896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851020.724614:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697024 00000100:00100000:0.0:1788851020.724619:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697024 00000100:00100000:0.0:1788851020.724639:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788851020.724648:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019697152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851020.724675:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851020.724694:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851020.724736:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019697152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.724742:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788851020.724900:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696896 00000100:00100000:0.0:1788851020.724904:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696896 00000100:00100000:0.0:1788851020.724919:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788851020.724924:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019697024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851020.724934:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851020.724992:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019697024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.724998:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788851020.725052:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788851020.725060:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019696896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788851020.725073:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851020.725097:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019696896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.725102:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788851020.725120:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851020.725123:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851020.725213:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019697280:0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.725240:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851020.725266:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019697792:0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.725286:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851020.725300:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019698304:0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.725315:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851020.725329:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788851020.725333:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019697664:0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.725350:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851020.725363:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019698176:0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.725390:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851020.725414:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697280 00000100:00100000:1.0:1788851020.725421:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697280 00000100:00100000:0.0:1788851020.725431:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697792 00000100:00100000:0.0:1788851020.725436:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697792 00000100:00100000:1.0:1788851020.725459:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788851020.725469:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698304 00000100:00100000:1.0:1788851020.725470:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019697280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.725472:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698304 00000100:00100000:0.0:1788851020.725511:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698176 00000100:00100000:0.0:1788851020.725516:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698176 00000100:00100000:1.0:1788851020.725529:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019697280:12345-0@lo:400:kworker.0 Request processed in 62us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.725535:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788851020.725541:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788851020.725547:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019697792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.725585:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019697792:12345-0@lo:400:kworker.0 Request processed in 43us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.725592:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788851020.725604:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788851020.725610:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019698304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.725633:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019698304:12345-0@lo:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.725638:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788851020.726025:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019697408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851020.726054:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851020.726078:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019697920:0@lo:400:kworker.0 00000100:00100000:3.0:1788851020.726096:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851020.726123:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019698432:0@lo:400:kworker.0 00000100:00100000:3.0:1788851020.726142:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851020.726154:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788851020.726158:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019697536:0@lo:400:kworker.0 00000100:00100000:3.0:1788851020.726174:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851020.726183:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019698048:0@lo:400:kworker.0 00000100:00100000:3.0:1788851020.726199:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851020.726210:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019698560:0@lo:400:kworker.0 00000100:00100000:3.0:1788851020.726228:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851020.726254:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697664 00000100:00100000:3.0:1788851020.726257:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697664 00000100:00100000:3.0:1788851020.726276:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697920 00000100:00100000:3.0:1788851020.726278:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697920 00000100:00100000:3.0:1788851020.726288:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788851020.726294:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019697664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851020.726404:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697408 00000100:00100000:2.0:1788851020.726408:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697408 00000100:00100000:2.0:1788851020.726433:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788851020.726438:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019697408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851020.726449:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851020.726480:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019697408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851020.726486:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788851020.726586:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788851020.726596:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019698176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.726626:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019698176:12345-0@lo:400:kworker.0 Request processed in 33us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.726631:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788851020.726641:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698432 00000100:00100000:0.0:1788851020.726644:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698432 00000100:00100000:0.0:1788851020.726656:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697536 00000100:00100000:0.0:1788851020.726659:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697536 00000100:00100000:0.0:1788851020.726668:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698048 00000100:00100000:0.0:1788851020.726671:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698048 00000100:00100000:0.0:1788851020.726682:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788851020.726686:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019698432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.726712:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019698432:12345-0@lo:400:kworker.0 Request processed in 25us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.726729:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788851020.726741:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788851020.726746:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019697536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.726770:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019697536:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.726776:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788851020.726784:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788851020.726788:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019698048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.726806:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019698048:12345-0@lo:400:kworker.0 Request processed in 18us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.726811:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788851020.726840:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851020.726844:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851020.726846:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788851020.726872:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879e4e00 x1875746019697152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851020.726890:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019697152:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788851020.726916:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879e6a00 x1875746019698176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851020.726925:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019698176:0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.726934:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019697280:0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.726944:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019697792:0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.726953:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019698304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851020.727056:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019697664:12345-0@lo:400:kworker.0 Request processed in 761us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851020.727063:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788851020.727075:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788851020.727081:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019697920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851020.727103:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019697920:12345-0@lo:400:kworker.0 Request processed in 23us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851020.727109:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788851020.727125:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698560 00000100:00100000:3.0:1788851020.727128:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698560 00000100:00100000:3.0:1788851020.727146:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788851020.727152:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019698560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851020.727183:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019698560:12345-0@lo:400:kworker.0 Request processed in 31us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851020.727190:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788851020.727217:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e19f80 x1875746019696896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851020.727231:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019696896:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788851020.727242:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea591ca80 x1875746019697024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851020.727253:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019697024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851020.727279:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019697536:0@lo:400:kworker.0 00000100:00100000:3.0:1788851020.727287:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019698048:0@lo:400:kworker.0 00010000:00080000:3.0:1788851020.727295:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879e7b80 x1875746019698560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851020.727302:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019698560:0@lo:400:kworker.0 00010000:00080000:3.0:1788851020.727507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1b480 x1875746019697408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851020.727519:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019697408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851020.727527:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019697920:0@lo:400:kworker.0 00010000:00080000:3.0:1788851020.727536:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879e6300 x1875746019698432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851020.727544:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019698432:0@lo:400:kworker.0 00000100:00100000:0.0:1788851020.727737:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019697664:0@lo:400:kworker.0 00010000:00010000:3.0:1788851020.982538:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851021.750799:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851021.750826:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019698688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851021.750897:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851021.751037:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698688 00000100:00100000:0.0:1788851021.751045:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698688 00000100:00100000:0.0:1788851021.751089:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788851021.751097:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019698688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788851021.751131:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788851021.751176:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019698688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851021.751183:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788851021.751403:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019698688:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788851022.015104:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851023.030145:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851023.604331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851023.604373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851023.604411:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851023.604449:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851023.604471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851023.604486:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851023.604507:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851023.605944:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747648 00000100:00100000:3.0:1788851023.606148:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747648 00000100:00100000:2.0:1788851023.606166:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748288 00000100:00100000:2.0:1788851023.606173:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748288 00000100:00100000:3.0:1788851023.606221:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 309 00000100:00100000:2.0:1788851023.606223:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748416 00000100:00100000:2.0:1788851023.606228:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748416 00000100:00100000:3.0:1788851023.606235:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000747648:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851023.606253:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1788851023.606263:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000748288:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851023.606314:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000747648:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 83us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851023.606335:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 309 00000100:00100000:0.0:1788851023.606369:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747776 00000100:00100000:0.0:1788851023.606374:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747776 00000100:00100000:0.0:1788851023.606406:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748032 00000100:00100000:0.0:1788851023.606409:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748032 00000100:00100000:0.0:1788851023.606422:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747904 00000100:00100000:0.0:1788851023.606425:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747904 00000100:00100000:0.0:1788851023.606436:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748160 00000100:00100000:0.0:1788851023.606438:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748160 00000100:00100000:0.0:1788851023.606451:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:0.0:1788851023.606458:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000747776:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851023.606506:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1788851023.606517:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000748416:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851023.606563:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:1.0:1788851023.606578:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000748032:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851023.609425:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000748288:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 3153us (5001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851023.609459:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1788851023.609726:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:2.0:1788851023.609744:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000747904:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851023.609829:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000747904:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 92us (5356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851023.609836:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:2.0:1788851023.609853:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00100000:2.0:1788851023.609861:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000748160:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851023.609888:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000748160:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (5400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851023.609893:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00080000:2.0:1788851023.609951:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851023.609970:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851023.609974:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788851023.609977:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851023.614522:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000747776:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 8051us (10199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851023.614673:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:3.0:1788851023.618204:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000748416:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 11674us (13680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851023.618222:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:1.0:1788851023.621088:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000748032:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 14501us (16701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851023.621104:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:3.0:1788851023.800529:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019698816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851023.800607:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851023.800690:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698816 00000100:00100000:3.0:1788851023.800697:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698816 00000100:00100000:3.0:1788851023.800741:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788851023.800751:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019698816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851023.800783:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788851023.800830:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019698816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851023.800836:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788851023.800885:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019698816:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788851024.054258:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851025.077721:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851025.844182:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019698944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851025.844191:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019699072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851025.844585:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019699200:0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.849237:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851025.849475:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851025.849570:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851025.849874:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699072 00000100:00100000:0.0:1788851025.849891:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699072 00000100:00100000:0.0:1788851025.849956:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698944 00000100:00100000:0.0:1788851025.849960:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698944 00000100:00100000:0.0:1788851025.849981:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788851025.849992:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019699072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851025.850049:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851025.850107:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019699072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.850114:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788851025.850126:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019699712:0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.850129:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788851025.850134:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019698944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788851025.850149:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851025.850160:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851025.850245:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019700224:0@lo:400:kworker.0 00000100:00080000:3.0:1788851025.850399:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851025.850404:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851025.850786:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019698944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 651us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.850794:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788851025.850797:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851025.850829:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019700736:0@lo:400:kworker.0 00010000:00080000:0.0:1788851025.850839:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5ad4e00 x1875746019698944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851025.850850:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851025.850861:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019698944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851025.850885:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019699584:0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.850912:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851025.850935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019700096:0@lo:400:kworker.0 00000100:00100000:3.0:1788851025.850939:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700224 00000100:00100000:3.0:1788851025.850946:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700224 00000100:00100000:2.0:1788851025.850952:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788851025.850956:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851025.850962:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019699328:0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.850974:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019700608:0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.850985:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851025.850993:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851025.851005:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019699840:0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.851043:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851025.851058:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019700352:0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.851075:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851025.851089:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019700864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851025.851105:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851025.851133:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699200 00000100:00100000:2.0:1788851025.851137:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699200 00000100:00100000:2.0:1788851025.851163:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788851025.851169:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019699200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.851402:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788851025.851416:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019699456:0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.851444:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851025.851463:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019699968:0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.851482:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851025.851499:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019700480:0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.851547:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019699200:12345-0@lo:400:kworker.0 Request processed in 377us (2318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851025.851554:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788851025.851584:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700864 00000100:00100000:2.0:1788851025.851587:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700864 00000100:00100000:2.0:1788851025.851608:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788851025.851614:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019700864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851025.851626:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851025.851654:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019700864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851025.851659:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788851025.851676:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699712 00000100:00100000:2.0:1788851025.851680:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699712 00000100:00100000:2.0:1788851025.851703:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699456 00000100:00100000:2.0:1788851025.851706:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699456 00000100:00100000:2.0:1788851025.851718:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788851025.851722:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019699712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.851752:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019699712:12345-0@lo:400:kworker.0 Request processed in 29us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851025.851757:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788851025.851766:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788851025.851770:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019699456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.851790:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019699456:12345-0@lo:400:kworker.0 Request processed in 19us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851025.851795:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788851025.851834:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851025.851848:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019700992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851025.851867:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851025.851895:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019699456:0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.851920:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699584 00000100:00100000:0.0:1788851025.851923:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699584 00000100:00100000:0.0:1788851025.851943:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699328 00000100:00100000:0.0:1788851025.851945:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699328 00000100:00100000:0.0:1788851025.851956:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699840 00000100:00100000:0.0:1788851025.851958:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699840 00000100:00100000:0.0:1788851025.851968:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700352 00000100:00100000:0.0:1788851025.851971:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700352 00000100:00100000:0.0:1788851025.851980:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699968 00000100:00100000:0.0:1788851025.851982:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699968 00000100:00100000:0.0:1788851025.851990:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700480 00000100:00100000:0.0:1788851025.851992:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700480 00000100:00100000:0.0:1788851025.852002:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788851025.852007:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019699584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.852051:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019699584:12345-0@lo:400:kworker.0 Request processed in 44us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.852056:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788851025.852067:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788851025.852071:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019699328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.852098:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019699328:12345-0@lo:400:kworker.0 Request processed in 27us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.852103:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788851025.852113:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788851025.852117:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019699840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.852137:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019699840:12345-0@lo:400:kworker.0 Request processed in 19us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.852142:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788851025.852153:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788851025.852159:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019700352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.852184:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019700352:12345-0@lo:400:kworker.0 Request processed in 25us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.852189:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788851025.852204:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788851025.852211:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019699968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.852245:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019699968:12345-0@lo:400:kworker.0 Request processed in 36us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.852251:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788851025.852263:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788851025.852269:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019700480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.852748:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019700480:12345-0@lo:400:kworker.0 Request processed in 478us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.852755:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788851025.854867:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700736 00000100:00100000:3.0:1788851025.854882:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700736 00000100:00100000:3.0:1788851025.854933:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700608 00000100:00100000:3.0:1788851025.854936:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700608 00000100:00100000:3.0:1788851025.854956:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788851025.854966:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019700224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.854969:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700096 00000100:00100000:2.0:1788851025.854976:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700096 00000100:00100000:0.0:1788851025.855008:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788851025.855040:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019700736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.855132:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019700736:12345-0@lo:400:kworker.0 Request processed in 96us (4280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.855142:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788851025.855167:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788851025.855174:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019700608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.855204:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019700608:12345-0@lo:400:kworker.0 Request processed in 32us (4210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.855211:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788851025.855246:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700992 00000100:00100000:0.0:1788851025.855251:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700992 00000100:00100000:0.0:1788851025.855271:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788851025.855291:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019700992:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788851025.855368:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788851025.855373:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851025.855377:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851025.855380:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851025.855416:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788851025.855426:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019700096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.855463:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019700096:12345-0@lo:400:kworker.0 Request processed in 41us (4507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851025.855468:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788851025.855623:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019699328:0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.855640:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019699840:0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.855651:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019700352:0@lo:400:kworker.0 00010000:00080000:2.0:1788851025.855663:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879c4700 x1875746019700864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851025.855686:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019700864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851025.855707:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019699200:0@lo:400:kworker.0 00000100:00100000:2.0:1788851025.855718:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019699712:0@lo:400:kworker.0 00010000:00080000:2.0:1788851025.855727:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879c7b80 x1875746019700736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851025.855734:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019700736:0@lo:400:kworker.0 00002000:00000024:0.0:1788851025.855871:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851025.855908:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019700992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 619us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851025.855915:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788851025.856005:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea591d180 x1875746019699968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851025.856099:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019700224:12345-0@lo:400:kworker.0 Request processed in 1133us (5299us total) trans 0 rc 0/0 00010000:00080000:2.0:1788851025.856110:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879c7100 x1875746019700224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851025.856121:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788851025.856129:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019700224:0@lo:400:kworker.0 00000100:00100000:0.0:1788851025.856209:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019699968:0@lo:400:kworker.0 00010000:00080000:0.0:1788851025.856225:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879c4000 x1875746019700480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851025.856234:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019700480:0@lo:400:kworker.0 00010000:00080000:0.0:1788851025.856243:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879c7800 x1875746019700992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851025.856268:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019700992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851025.856296:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019699584:0@lo:400:kworker.0 00010000:00080000:0.0:1788851025.856408:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879c5180 x1875746019700096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851025.856417:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019700096:0@lo:400:kworker.0 00010000:00080000:0.0:1788851025.856428:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879c6300 x1875746019700608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851025.856434:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019700608:0@lo:400:kworker.0 00010000:00080000:0.0:1788851025.856472:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879e4000 x1875746019699072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851025.856485:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019699072:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1788851026.101463:0:12519:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788851026.101714:0:12519:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788851026.104660:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851026.868621:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019701120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851026.868725:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851026.868885:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701120 00000100:00100000:3.0:1788851026.868895:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701120 00000100:00100000:3.0:1788851026.868963:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788851026.868974:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019701120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851026.869047:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851026.869108:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019701120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851026.869116:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788851026.869219:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019701120:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851027.144939:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851028.148890:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851028.729552:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851028.729600:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851028.729641:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851028.729678:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851028.729702:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851028.729723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851028.729751:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851028.729784:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749184 00000100:00100000:3.0:1788851028.729796:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749184 00000100:00100000:3.0:1788851028.729867:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749312 00000100:00100000:3.0:1788851028.729871:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749312 00000100:00100000:3.0:1788851028.729899:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:3.0:1788851028.729914:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000749184:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851028.730007:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000749184:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 97us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851028.730081:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:3.0:1788851028.730101:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:3.0:1788851028.730122:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000749312:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851028.730277:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748672 00000100:00100000:0.0:1788851028.730282:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748672 00000100:00100000:0.0:1788851028.730319:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748928 00000100:00100000:0.0:1788851028.730323:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748928 00000100:00100000:0.0:1788851028.730339:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748800 00000100:00100000:0.0:1788851028.730343:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748800 00000100:00100000:0.0:1788851028.730359:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749056 00000100:00100000:0.0:1788851028.730362:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749056 00000100:00100000:0.0:1788851028.730381:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:0.0:1788851028.730388:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000748672:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851028.730424:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000748672:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851028.730443:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:0.0:1788851028.730459:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:0.0:1788851028.730466:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000748928:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851028.730493:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000748928:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851028.730500:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:0.0:1788851028.730512:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:0.0:1788851028.730519:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000748800:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851028.730544:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000748800:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851028.730551:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:0.0:1788851028.730564:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:0.0:1788851028.730570:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000749056:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851028.730594:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000749056:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851028.730601:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00080000:0.0:1788851028.730654:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851028.730658:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851028.730661:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851028.730664:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851028.730807:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748544 00000100:00100000:2.0:1788851028.730813:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748544 00000100:00100000:2.0:1788851028.730855:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 311 00000100:00100000:2.0:1788851028.730863:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000748544:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851028.730891:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000748544:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851028.730898:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 311 00000100:00100000:3.0:1788851028.732535:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000749312:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851028.732550:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000020:00000004:1.0:1788851028.797858:0:12617:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851028.798147:0:12617:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788851028.918598:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851028.918630:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019701248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851028.918729:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851028.918854:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701248 00000100:00100000:0.0:1788851028.918866:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701248 00000100:00100000:0.0:1788851028.918938:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788851028.918950:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019701248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851028.919032:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788851028.919095:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019701248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851028.919103:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788851028.919157:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019701248:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788851029.172423:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851030.197031:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851030.964264:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851030.964288:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019701376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851030.964386:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851030.964548:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019701760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851030.964581:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.964759:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019701632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851030.964827:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019701504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851030.965807:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019701888:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.965863:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.966183:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851030.966192:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019702272:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.966305:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.966355:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701888 00000100:00100000:2.0:1788851030.966366:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701888 00000100:00100000:2.0:1788851030.966423:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788851030.966434:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019701888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.966509:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3650:x1875746019701888:12345-0@lo:400:kworker.0 Request processed in 75us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.966518:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788851030.966591:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019701888:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.966783:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.966824:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019702144:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.966864:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.966903:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851030.966911:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019702016:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.966933:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.966963:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.967353:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019702400:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.967383:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.967516:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851030.967523:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019702784:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.967551:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.967600:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702144 00000100:00100000:2.0:1788851030.967607:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702144 00000100:00100000:2.0:1788851030.967639:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702400 00000100:00100000:2.0:1788851030.967641:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702400 00000100:00100000:2.0:1788851030.967721:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788851030.967732:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019702144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.967776:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019702144:12345-0@lo:400:kworker.0 Request processed in 46us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.967783:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788851030.967799:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788851030.967804:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019702400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.967833:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019702400:12345-0@lo:400:kworker.0 Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.967840:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788851030.967858:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702272 00000100:00100000:2.0:1788851030.967862:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702272 00000100:00100000:2.0:1788851030.967887:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702016 00000100:00100000:2.0:1788851030.967890:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702016 00000100:00100000:2.0:1788851030.967904:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702784 00000100:00100000:2.0:1788851030.967907:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702784 00000100:00100000:2.0:1788851030.967939:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788851030.967945:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019702272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.967974:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019702272:12345-0@lo:400:kworker.0 Request processed in 29us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.967980:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788851030.967991:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788851030.967996:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019702016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851030.968333:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701376 00000100:00100000:2.0:1788851030.968624:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019702016:12345-0@lo:400:kworker.0 Request processed in 204us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851030.968633:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701376 00000100:00100000:2.0:1788851030.968650:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788851030.968687:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701760 00000100:00100000:1.0:1788851030.968691:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701760 00000100:00100000:1.0:1788851030.968707:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701632 00000100:00100000:1.0:1788851030.968709:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701632 00000100:00100000:1.0:1788851030.968741:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701504 00000100:00100000:2.0:1788851030.968747:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788851030.968750:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701504 00000100:00100000:2.0:1788851030.968765:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019702784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851030.968775:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788851030.968808:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019701376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851030.968818:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019702784:12345-0@lo:400:kworker.0 Request processed in 56us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.968828:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788851030.968849:0:8451:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00002000:00000024:1.0:1788851030.968856:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788851030.968877:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851030.968881:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019702528:0@lo:400:kworker.0 00000100:00080000:0.0:1788851030.968885:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851030.968892:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851030.968918:0:8451:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788851030.968937:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851030.968950:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019702912:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.968998:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.969056:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851030.969063:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019702656:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.969086:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.969120:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702528 00000100:00100000:2.0:1788851030.969126:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702528 00000100:00100000:2.0:1788851030.969159:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702656 00000100:00100000:2.0:1788851030.969161:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702656 00000100:00100000:2.0:1788851030.969198:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788851030.969214:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019702528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.969251:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019702528:12345-0@lo:400:kworker.0 Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.969257:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788851030.969269:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788851030.969275:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019702656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.969299:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019702656:12345-0@lo:400:kworker.0 Request processed in 25us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.969304:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1788851030.969325:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851030.969328:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851030.969362:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019702016:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.969376:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019702144:0@lo:400:kworker.0 00010000:00080000:2.0:1788851030.969407:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c56680 x1875746019702656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851030.969418:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019702656:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.969427:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019702528:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.969447:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019702784:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.969630:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019702400:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.969642:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019702272:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.969930:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788851030.969940:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019701760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851030.969958:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851030.970037:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019701760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (5430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.970044:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788851030.970061:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788851030.970068:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019701632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851030.970089:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851030.970124:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019701632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (3343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.970130:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788851030.970150:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788851030.970156:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019701504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788851030.970167:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851030.970217:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019701504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (3254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.970224:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1788851030.970250:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879e4000 x1875746019701504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851030.970267:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019701504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851030.970520:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788851030.970560:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879e7100 x1875746019701760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851030.970574:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019701760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851030.970595:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702912 00000100:00100000:3.0:1788851030.970600:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702912 00000100:00100000:3.0:1788851030.970644:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00010000:00080000:0.0:1788851030.970644:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d879e7b80 x1875746019701632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851030.970651:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019702912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851030.970659:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019701632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851030.970838:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019702912:12345-0@lo:400:kworker.0 Request processed in 187us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851030.970845:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1788851030.970864:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851030.971110:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019701376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2302us (6719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851030.971125:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1788851030.974962:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c56300 x1875746019702912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851030.974988:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019702912:0@lo:400:kworker.0 00010000:00080000:2.0:1788851030.975099:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1b480 x1875746019701376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851030.975274:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019701376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788851031.221150:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788851031.513673:0:12715:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788851031.514382:0:12715:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788851031.994424:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851031.994451:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019703040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851031.994526:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851031.995774:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703040 00000100:00100000:3.0:1788851031.995787:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703040 00000100:00100000:3.0:1788851031.995853:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788851031.995864:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019703040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851031.995906:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851031.996001:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019703040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851031.996008:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788851031.996080:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019703040:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788851032.244294:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851033.269182:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788851033.725701:0:12813:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788851033.725955:0:12813:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788851033.855488:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851033.855521:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851033.855544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851033.855549:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749568 00000100:00100000:0.0:1788851033.855560:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749568 00000100:00100000:2.0:1788851033.855580:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851033.855601:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851033.856027:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851033.856056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851033.862177:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749824 00000100:00100000:0.0:1788851033.862199:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749824 00000100:00100000:0.0:1788851033.862272:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749696 00000100:00100000:0.0:1788851033.862276:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749696 00000100:00100000:0.0:1788851033.862290:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749952 00000100:00100000:0.0:1788851033.862292:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749952 00000100:00100000:0.0:1788851033.862334:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:0.0:1788851033.862344:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000749568:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851033.862442:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000749568:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 99us (6974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851033.862450:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:0.0:1788851033.862542:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 170 00000100:00100000:0.0:1788851033.862550:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000749824:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851033.862576:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000749824:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (7055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851033.862583:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 170 00000100:00100000:0.0:1788851033.862595:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 171 00000100:00100000:0.0:1788851033.862601:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000749696:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851033.862626:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000749696:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (7044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851033.862632:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 171 00000100:00100000:0.0:1788851033.862644:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 172 00000100:00100000:0.0:1788851033.862652:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000749952:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851033.862678:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000749952:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (7076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851033.862685:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 172 00000100:00100000:0.0:1788851033.862722:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749440 00000100:00100000:0.0:1788851033.862726:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749440 00000100:00100000:0.0:1788851033.862758:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 313 00000100:00100000:0.0:1788851033.862765:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000749440:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851033.862798:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000749440:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 34us (7252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851033.862805:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 313 00000100:00100000:0.0:1788851033.862836:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750080 00000100:00100000:0.0:1788851033.862840:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750080 00000100:00100000:0.0:1788851033.862871:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750208 00000100:00100000:0.0:1788851033.862875:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750208 00000100:00100000:0.0:1788851033.863150:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1788851033.863158:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2406:x1875746000750080:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:0.0:1788851033.863179:0:8447:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205a39 00000100:00080000:0.0:1788851033.863188:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892d876bd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851033.863241:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788851033.863390:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+2:2406:x1875746000750080:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 231us (7379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851033.863396:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1788851033.863410:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1788851033.863417:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2406:x1875746000750208:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:0.0:1788851033.863427:0:8447:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205a40 00000100:00080000:0.0:1788851033.863433:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892d876bd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851033.863455:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788851033.863600:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+2:2406:x1875746000750208:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 183us (7543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851033.863606:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00010000:00010000:0.0:1788851033.863783:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788851033.866407:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788851033.866417:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851033.866439:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851033.866443:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788851033.867089:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851034.043353:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019703168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851034.043453:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851034.043581:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703168 00000100:00100000:1.0:1788851034.043592:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703168 00000100:00100000:1.0:1788851034.043665:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788851034.043675:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019703168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851034.043714:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788851034.055972:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019703168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12286us (12507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851034.055988:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788851034.056359:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019703168:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788851034.294398:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851035.317804:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788851035.718707:0:12911:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851035.718985:0:12911:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788851036.084686:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019703296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851036.084764:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.084827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019703808:0@lo:400:kworker.0 00000100:00100000:2.0:1788851036.084853:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.084872:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019704320:0@lo:400:kworker.0 00000100:00100000:2.0:1788851036.084891:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.084906:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019704832:0@lo:400:kworker.0 00000100:00100000:2.0:1788851036.084923:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.084937:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788851036.084942:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019703424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851036.084959:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.084973:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019703936:0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.084973:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019703552:0@lo:400:kworker.0 00000100:00100000:2.0:1788851036.084991:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851036.085000:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.085005:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019704448:0@lo:400:kworker.0 00000100:00100000:2.0:1788851036.085046:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.085071:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019704960:0@lo:400:kworker.0 00000100:00100000:3.0:1788851036.085235:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704320 00000100:00100000:3.0:1788851036.085242:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704320 00000100:00100000:3.0:1788851036.085308:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704832 00000100:00100000:3.0:1788851036.085312:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704832 00000100:00100000:3.0:1788851036.085332:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703936 00000100:00100000:3.0:1788851036.085335:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703936 00000100:00100000:3.0:1788851036.085349:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788851036.085358:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019704320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851036.085412:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019704320:12345-0@lo:400:kworker.0 Request processed in 56us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.085418:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788851036.085435:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788851036.085441:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019704832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851036.085465:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019704832:12345-0@lo:400:kworker.0 Request processed in 24us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.085470:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788851036.085481:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788851036.085487:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019703936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851036.085513:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019703936:12345-0@lo:400:kworker.0 Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.085519:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788851036.085540:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703296 00000100:00100000:3.0:1788851036.085544:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703296 00000100:00100000:1.0:1788851036.085571:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019704064:0@lo:400:kworker.0 00000100:00100000:3.0:1788851036.085581:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703424 00000100:00100000:3.0:1788851036.085584:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703424 00000100:00100000:1.0:1788851036.085597:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851036.085598:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788851036.085604:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019703296:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851036.085613:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019704576:0@lo:400:kworker.0 00002000:00000024:3.0:1788851036.085626:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851036.085637:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019703680:0@lo:400:kworker.0 00000100:00100000:3.0:1788851036.085654:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019703296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.085659:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851036.085660:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788851036.085672:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788851036.085677:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019703424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851036.085685:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019704192:0@lo:400:kworker.0 00002000:00000024:3.0:1788851036.085686:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851036.085704:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851036.085707:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019703424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.085713:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788851036.085725:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019704704:0@lo:400:kworker.0 00000100:00080000:3.0:1788851036.085732:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851036.085736:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851036.085744:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703680 00000100:00100000:1.0:1788851036.085745:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851036.085748:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703680 00000100:00100000:1.0:1788851036.085757:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851036.085762:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704192 00000100:00100000:1.0:1788851036.085763:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019705088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851036.085764:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704192 00000100:00100000:3.0:1788851036.085779:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704704 00000100:00100000:3.0:1788851036.085781:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704704 00000100:00100000:1.0:1788851036.085781:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851036.085793:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788851036.085798:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019703680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.085801:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703808 00000100:00100000:1.0:1788851036.085804:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703808 00000100:00100000:1.0:1788851036.085822:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704064 00000100:00100000:1.0:1788851036.085825:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704064 00000100:00100000:3.0:1788851036.085831:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019703680:12345-0@lo:400:kworker.0 Request processed in 33us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.085837:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788851036.085837:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788851036.085842:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019703808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851036.085846:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788851036.085857:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019704192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.085873:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019703808:12345-0@lo:400:kworker.0 Request processed in 31us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.085879:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019704192:12345-0@lo:400:kworker.0 Request processed in 24us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.085879:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788851036.085884:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788851036.085891:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788851036.085892:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788851036.085896:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019704064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851036.085897:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019704704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851036.085920:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019704704:12345-0@lo:400:kworker.0 Request processed in 23us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.085922:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019704064:12345-0@lo:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.085926:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788851036.085927:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788851036.085941:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705088 00000100:00100000:1.0:1788851036.085941:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703552 00000100:00100000:3.0:1788851036.085944:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705088 00000100:00100000:1.0:1788851036.085944:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703552 00000100:00100000:3.0:1788851036.085958:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788851036.085964:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019705088:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851036.085964:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788851036.085969:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019703552:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788851036.085978:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851036.085996:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019703552:12345-0@lo:400:kworker.0 Request processed in 26us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.085999:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019705088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.086002:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788851036.086005:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1788851036.086055:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c56300 x1875746019705088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851036.086073:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019705088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851036.086097:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019703680:0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.086109:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704448 00000100:00100000:3.0:1788851036.086115:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019704192:0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.086117:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704448 00000100:00100000:3.0:1788851036.086123:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019704704:0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.086143:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788851036.086147:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851036.086150:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019704448:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788851036.086155:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851036.086336:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019704448:12345-0@lo:400:kworker.0 Request processed in 185us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.086343:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788851036.086604:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788851036.086656:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e14380 x1875746019704320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851036.086666:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019704320:0@lo:400:kworker.0 00010000:00080000:2.0:1788851036.086676:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e16300 x1875746019704832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851036.086696:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019704832:0@lo:400:kworker.0 00000100:00100000:2.0:1788851036.086709:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019703808:0@lo:400:kworker.0 00010000:00080000:2.0:1788851036.086719:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c56d80 x1875746019703296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851036.086730:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019703296:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788851036.086751:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e18e00 x1875746019703424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851036.086763:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019703424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851036.086773:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019703936:0@lo:400:kworker.0 00010000:00080000:2.0:1788851036.086781:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e14700 x1875746019704448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851036.086789:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019704448:0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.086795:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704960 00000100:00100000:1.0:1788851036.086799:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704960 00000100:00100000:2.0:1788851036.086809:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851036.086824:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704576 00000100:00100000:1.0:1788851036.086827:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704576 00000100:00100000:2.0:1788851036.086836:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019703552:0@lo:400:kworker.0 00000100:00100000:2.0:1788851036.086845:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019704064:0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.086845:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788851036.086851:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019704960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851036.086864:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788851036.086870:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019704576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.086886:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019704960:12345-0@lo:400:kworker.0 Request processed in 36us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.086893:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788851036.086898:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019704576:12345-0@lo:400:kworker.0 Request processed in 29us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.086903:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788851036.086908:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788851036.086931:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e15880 x1875746019704576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851036.086941:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019704576:0@lo:400:kworker.0 00010000:00080000:2.0:1788851036.086960:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e17800 x1875746019704960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851036.086967:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019704960:0@lo:400:kworker.0 00000100:00100000:1.0:1788851036.088772:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851036.088790:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019705216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851036.088852:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.088950:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705216 00000100:00100000:2.0:1788851036.088957:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705216 00000100:00100000:2.0:1788851036.089084:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788851036.089094:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019705216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851036.089124:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851036.089169:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019705216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.089188:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788851036.089445:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c96680 x1875746019705216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851036.089464:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019705216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851036.342234:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851037.110595:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851037.110619:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019705344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851037.110704:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851037.110780:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705344 00000100:00100000:1.0:1788851037.110788:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705344 00000100:00100000:1.0:1788851037.110835:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788851037.110844:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019705344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788851037.110878:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788851037.110925:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019705344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851037.110945:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788851037.111476:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019705344:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851037.367151:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851038.389687:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851038.964665:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851038.964705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851038.964738:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851038.964764:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851038.964789:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851038.964818:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750592 00000100:00100000:3.0:1788851038.964829:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750592 00000100:00100000:3.0:1788851038.964901:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750848 00000100:00100000:3.0:1788851038.964905:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750848 00000100:00100000:3.0:1788851038.964930:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750464 00000100:00100000:3.0:1788851038.964933:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750464 00000100:00100000:3.0:1788851038.964973:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750720 00000100:00100000:3.0:1788851038.964977:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750720 00000100:00100000:3.0:1788851038.965009:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:3.0:1788851038.965062:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000750592:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851038.965509:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000750592:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 447us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851038.965520:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:3.0:1788851038.965543:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:3.0:1788851038.965551:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000750848:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851038.965581:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000750848:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851038.965587:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:3.0:1788851038.965619:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:3.0:1788851038.965626:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000750464:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851038.965663:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000750464:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851038.965669:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:3.0:1788851038.965683:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:3.0:1788851038.965689:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000750720:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851038.965717:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000750720:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851038.965723:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00080000:3.0:1788851038.967250:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851038.967257:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851038.968088:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750336 00000100:00100000:2.0:1788851038.968108:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750336 00000100:00100000:2.0:1788851038.968188:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 315 00000100:00100000:2.0:1788851038.968200:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000750336:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851038.968293:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000750336:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 95us (3639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851038.968300:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 315 00000100:00100000:0.0:1788851039.160605:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019705472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851039.160712:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851039.162118:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705472 00000100:00100000:0.0:1788851039.162135:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705472 00000100:00100000:0.0:1788851039.162205:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788851039.162218:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019705472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851039.162269:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788851039.162370:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019705472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851039.162377:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788851039.162442:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019705472:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788851039.416259:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788851039.546112:0:13055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788851039.669969:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4c53046-d9be-47e4-bc50-30ccb352d04d 00000020:00000080:2.0:1788851039.669978:0:8443:0:(genops.c:885:class_export_put()) final put ffff892d876bf800/f4c53046-d9be-47e4-bc50-30ccb352d04d 00000020:00000080:1.0:1788851039.673266:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892d876bf800/f4c53046-d9be-47e4-bc50-30ccb352d04d for lustre-OST0000 00000020:00000080:1.0:1788851039.673340:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d876bd000 for lustre-OST0000 00000001:00100000:1.0:1788851039.674100:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4c53046-d9be-47e4-bc50-30ccb352d04d 00000020:00000080:1.0:1788851039.674106:0:9528:0:(genops.c:885:class_export_put()) final put ffff892d876bc000/f4c53046-d9be-47e4-bc50-30ccb352d04d 00000020:00000080:2.0:1788851039.674187:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d876bc000/f4c53046-d9be-47e4-bc50-30ccb352d04d for lustre-OST0001 00000020:00000080:2.0:1788851039.674228:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d876bd800 for lustre-OST0001 00010000:00010000:0.0:1788851040.436453:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851041.204232:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851041.204255:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019705600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851041.204326:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851041.204390:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705600 00000100:00100000:2.0:1788851041.204398:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705600 00000100:00100000:2.0:1788851041.204457:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788851041.204467:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019705600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851041.204495:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851041.204541:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019705600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.204548:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788851041.204567:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788851041.204594:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c94a80 x1875746019705600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851041.204616:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019705600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851041.205532:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019705856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851041.205575:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851041.205597:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019706368:0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.205621:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851041.205640:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019706880:0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.205662:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851041.205685:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019707392:0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.205702:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851041.205718:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788851041.205723:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019705984:0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.205744:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851041.205760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019706496:0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.205776:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851041.205790:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019707008:0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.205804:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851041.205827:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706368 00000100:00100000:1.0:1788851041.205832:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706368 00000100:00100000:1.0:1788851041.205875:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788851041.205881:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019706368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.205920:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019706368:12345-0@lo:400:kworker.0 Request processed in 38us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851041.205926:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788851041.205944:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706880 00000100:00100000:1.0:1788851041.205947:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706880 00000100:00100000:1.0:1788851041.205974:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707392 00000100:00100000:1.0:1788851041.205990:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707392 00000100:00100000:1.0:1788851041.206008:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707008 00000100:00100000:1.0:1788851041.206032:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707008 00000100:00100000:1.0:1788851041.206048:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788851041.206054:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019706880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.206085:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019706880:12345-0@lo:400:kworker.0 Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851041.206092:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788851041.206103:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788851041.206108:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019707392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.206137:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019707392:12345-0@lo:400:kworker.0 Request processed in 29us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851041.206142:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788851041.206151:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851041.206156:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019707008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.206178:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019707008:12345-0@lo:400:kworker.0 Request processed in 22us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851041.206183:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851041.206201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705984 00000100:00100000:1.0:1788851041.206210:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705984 00000100:00100000:1.0:1788851041.206236:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788851041.206242:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019705984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.206274:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019705984:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851041.206280:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788851041.206307:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706496 00000100:00100000:1.0:1788851041.206310:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706496 00000100:00100000:1.0:1788851041.206334:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788851041.206340:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019706496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.206369:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019706496:12345-0@lo:400:kworker.0 Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851041.206375:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788851041.206409:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019705984:0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.206420:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019706496:0@lo:400:kworker.0 00010000:00080000:1.0:1788851041.206431:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd4380 x1875746019707008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851041.206440:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019707008:0@lo:400:kworker.0 00000100:00100000:1.0:1788851041.206449:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019706368:0@lo:400:kworker.0 00010000:00080000:1.0:1788851041.206457:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd4a80 x1875746019706880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851041.206466:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019706880:0@lo:400:kworker.0 00010000:00080000:1.0:1788851041.206474:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd4e00 x1875746019707392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851041.206494:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019707392:0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.207535:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705856 00000100:00100000:2.0:1788851041.207541:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705856 00000100:00100000:2.0:1788851041.207573:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788851041.207580:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019705856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851041.207596:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851041.207639:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019705856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.207658:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788851041.207688:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019707520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851041.207718:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851041.207753:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707520 00000100:00100000:2.0:1788851041.207763:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707520 00000100:00100000:2.0:1788851041.207785:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788851041.207790:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019707520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851041.207807:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851041.207836:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019707520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.207842:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1788851041.207856:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788851041.207860:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788851041.207879:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c94a80 x1875746019707520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851041.207894:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019707520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851041.207920:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019705728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851041.207945:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851041.207963:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019706240:0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.207997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851041.208044:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019706752:0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208067:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851041.208085:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019707264:0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208119:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851041.208143:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788851041.208150:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019706112:0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208175:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851041.208193:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019706624:0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208211:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851041.208241:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019707136:0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208261:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851041.208287:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706752 00000100:00100000:2.0:1788851041.208291:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706752 00000100:00100000:2.0:1788851041.208316:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707264 00000100:00100000:2.0:1788851041.208319:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707264 00000100:00100000:2.0:1788851041.208333:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706112 00000100:00100000:2.0:1788851041.208336:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706112 00000100:00100000:2.0:1788851041.208345:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706624 00000100:00100000:2.0:1788851041.208347:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706624 00000100:00100000:2.0:1788851041.208357:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707136 00000100:00100000:2.0:1788851041.208359:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707136 00000100:00100000:2.0:1788851041.208372:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788851041.208378:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019706752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208413:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019706752:12345-0@lo:400:kworker.0 Request processed in 35us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.208418:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788851041.208431:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788851041.208436:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019707264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208463:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019707264:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.208469:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788851041.208480:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788851041.208485:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019706112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208509:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019706112:12345-0@lo:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.208514:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788851041.208525:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788851041.208538:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019706624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208566:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019706624:12345-0@lo:400:kworker.0 Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.208572:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788851041.208583:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788851041.208589:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019707136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208613:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019707136:12345-0@lo:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.208618:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:2.0:1788851041.208641:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851041.208644:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851041.208652:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706240 00000100:00100000:2.0:1788851041.208655:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706240 00000100:00100000:2.0:1788851041.208677:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788851041.208683:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019706240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851041.208713:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019706240:12345-0@lo:400:kworker.0 Request processed in 29us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.208719:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788851041.208735:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705728 00000100:00100000:2.0:1788851041.208739:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705728 00000100:00100000:2.0:1788851041.208756:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788851041.208761:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019705728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788851041.208771:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851041.208794:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019705728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851041.208800:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788851041.208837:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8748b480 x1875746019705856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851041.208858:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019705856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851041.209834:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019706112:0@lo:400:kworker.0 00000100:00100000:3.0:1788851041.209847:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019706624:0@lo:400:kworker.0 00000100:00100000:3.0:1788851041.209857:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019707136:0@lo:400:kworker.0 00010000:00080000:3.0:1788851041.209871:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c56680 x1875746019705728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851041.209885:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019705728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851041.209897:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019706240:0@lo:400:kworker.0 00010000:00080000:3.0:1788851041.209906:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd7800 x1875746019706752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851041.209914:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019706752:0@lo:400:kworker.0 00010000:00080000:3.0:1788851041.209936:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd4000 x1875746019707264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851041.209944:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019707264:0@lo:400:kworker.0 00010000:00010000:1.0:1788851041.462175:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851042.230876:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851042.231167:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019707648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851042.231238:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851042.231888:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707648 00000100:00100000:0.0:1788851042.231897:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707648 00000100:00100000:0.0:1788851042.231953:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788851042.231976:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019707648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788851042.232036:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788851042.232105:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019707648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851042.232120:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788851042.232169:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019707648:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851042.484338:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788851042.968803:0:13203:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1fe81db0 20000000:00000080:0.0:1788851042.968818:0:13203:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892ea567c400 uarg=0000000000000000 20000000:01000000:0.0:1788851042.968858:0:13203:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788851042.968864:0:13203:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788851042.968868:0:13203:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788851042.970594:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788851042.970849:0:13203:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788851042.979549:0:13203:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788851042.979584:0:13203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979605:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38955 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979613:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2059de expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979620:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2059ec expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979627:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2059fa expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979633:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a08 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979640:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38994 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979661:0:13203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979703:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38994 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979718:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38994 expref: 12 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.979733:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019707776:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851042.979920:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205a08 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.979929:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205a08 expref: 23 pid: 6526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.979938:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019707904:0@lo:104: 00000100:00100000:0.0:1788851042.980004:0:13203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851042.980069:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2059fa expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.980078:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2059fa expref: 23 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.980086:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019708032:0@lo:104: 00000100:00100000:0.0:1788851042.980205:0:13203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851042.980283:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2059ec expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.980301:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2059ec expref: 23 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.980310:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019708160:0@lo:104: 00000100:00100000:0.0:1788851042.980333:0:13203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851042.980394:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2059de expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.980402:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2059de expref: 23 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.980411:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019708288:0@lo:104: 00000100:00100000:0.0:1788851042.980432:0:13203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851042.980448:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707904 00000100:00100000:1.0:1788851042.980455:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707904 00000100:00100000:2.0:1788851042.980461:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708032 00000100:00100000:2.0:1788851042.980465:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708032 00000100:00100000:2.0:1788851042.980493:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708160 00000100:00100000:2.0:1788851042.980496:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708160 00000100:00100000:1.0:1788851042.980497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788851042.980505:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:13203:x1875746019707904:12345-0@lo:104: 00010000:00010000:1.0:1788851042.980517:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980575:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788851042.980581:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:13203:x1875746019707904:12345-0@lo:104: Request processed in 77us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851042.980588:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788851042.980607:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788851042.980613:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:13203:x1875746019708032:12345-0@lo:104: 00010000:00010000:1.0:1788851042.980621:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980653:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788851042.980657:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:13203:x1875746019708032:12345-0@lo:104: Request processed in 46us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851042.980662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788851042.980675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788851042.980681:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:13203:x1875746019708160:12345-0@lo:104: 00010000:00010000:1.0:1788851042.980688:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980727:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788851042.980731:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:13203:x1875746019708160:12345-0@lo:104: Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851042.980736:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788851042.980752:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788851042.980771:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980778:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851042.980782:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980790:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851042.980797:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851042.980802:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851042.980829:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980836:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851042.980857:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980864:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b205a08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a0f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980886:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851042.980890:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980895:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851042.980898:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980904:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851042.980910:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851042.980915:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851042.980928:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980934:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851042.980958:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980964:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b2059fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a01 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980972:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851042.980975:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980989:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d400 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851042.980992:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.980998:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851042.981004:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851042.981027:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851042.981042:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.981049:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851042.981055:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.981061:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b2059ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2059f3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.981070:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851042.981072:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851042.981074:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851042.981086:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019708416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851042.981226:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851042.981295:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851042.981306:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019708544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851042.981335:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851042.981363:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851042.981369:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019708672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851042.981389:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851042.981409:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708416 00000100:00100000:1.0:1788851042.981414:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708416 00010000:00010000:1.0:1788851042.981432:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a08 expref: 24 pid: 6526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851042.981459:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708544 00000100:00100000:1.0:1788851042.981462:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708544 00010000:00010000:1.0:1788851042.981473:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2059fa expref: 25 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851042.981481:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708672 00000100:00100000:1.0:1788851042.981484:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708672 00010000:00010000:1.0:1788851042.981491:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2059ec expref: 26 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851042.981502:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851042.981508:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+26:3648:x1875746019708416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851042.981519:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851042.981523:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a08 expref: 26 pid: 6526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.981532:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205a08 expref: 26 pid: 6526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.981546:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851042.981548:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788851042.981556:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+26:3649:x1875746019708544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851042.981564:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851042.981569:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2059fa expref: 26 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851042.981573:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+26:3648:x1875746019708416:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (348us total) trans 0 rc 0/0 00010000:00010000:2.0:1788851042.981578:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2059fa expref: 26 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851042.981579:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788851042.981587:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851042.981592:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788851042.981597:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3649:x1875746019708672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851042.981606:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851042.981610:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2059ec expref: 25 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851042.981611:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3649:x1875746019708544:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851042.981617:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788851042.981628:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2059ec expref: 24 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.981638:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851042.981650:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019708544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851042.981656:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019708672:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851042.981662:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788851042.981665:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019708672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851042.981686:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019708416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851042.981860:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38955 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.981871:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38955 expref: 12 pid: 6528 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.981883:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019708800:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851042.981923:0:13203:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead739d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788851042.981936:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6800/0x3e0030720b205a0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205a08 expref: 23 pid: 6526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.981962:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019707904:0@lo:104: 00010000:00010000:0.0:1788851042.981972:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2059fa expref: 22 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.981991:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019708032:0@lo:104: 00010000:00010000:0.0:1788851042.982001:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031400/0x3e0030720b2059f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2059ec expref: 21 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.982009:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019708160:0@lo:104: 00000100:00100000:1.0:1788851042.982073:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708288 00000100:00100000:1.0:1788851042.982077:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708288 00000100:00100000:1.0:1788851042.985349:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851042.985370:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:13203:x1875746019708288:12345-0@lo:104: 00010000:00010000:1.0:1788851042.985390:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851042.985497:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788851042.985504:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:13203:x1875746019708288:12345-0@lo:104: Request processed in 143us (5070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851042.985521:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788851042.985750:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019708288:0@lo:104: 00010000:00010000:3.0:1788851042.985955:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851042.985962:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851042.985971:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6e00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851042.985975:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851042.985983:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851042.985992:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851042.986002:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788851042.986070:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851042.986078:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851042.986101:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851042.986126:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892d876e6e00/0x3e0030720b2059de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2059e5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851042.986285:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851042.986288:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851042.986290:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851042.986304:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019708928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851042.986349:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851042.986443:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708928 00000100:00100000:2.0:1788851042.986450:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708928 00010000:00010000:2.0:1788851042.986477:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2059de expref: 21 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851042.986548:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788851042.986557:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:3647:x1875746019708928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851042.986568:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851042.986574:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2059de expref: 21 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851042.986583:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2059de expref: 21 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851042.986596:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80030400/0x3e0030720b2059e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2059de expref: 21 pid: 6529 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851042.986618:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851042.986658:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:3647:x1875746019708928:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851042.986665:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788851042.986858:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019708928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851042.988781:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019707776:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851042.988797:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875746019708800:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851042.988920:0:13203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851042.991555:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851042.992635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851042.992826:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750976 00000100:00100000:0.0:1788851042.992837:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750976 00010000:00010000:0.0:1788851042.992931:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38994 expref: 13 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.993080:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751104 00000100:00100000:0.0:1788851042.993084:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751104 00000100:00100000:3.0:1788851042.993214:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:3.0:1788851042.993228:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+14:2408:x1875746000750976:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851042.993244:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851042.993252:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38994 expref: 14 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851042.993265:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38994 expref: 14 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851042.993283:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031a00/0x3e0030720b205a24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38994 expref: 14 pid: 6526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851042.993298:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851042.993358:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2408:x1875746000750976:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 134us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851042.993365:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00010000:00010000:0.0:1788851042.993457:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38955 expref: 12 pid: 6528 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851042.993486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:0.0:1788851042.993494:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:2408:x1875746000751104:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851042.993502:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851042.993507:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38955 expref: 12 pid: 6528 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993516:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38955 expref: 12 pid: 6528 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993527:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6000/0x3e0030720b2059d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38955 expref: 12 pid: 6528 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993557:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993566:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993583:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993590:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993595:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993602:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993607:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851042.993611:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993619:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993630:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851042.993641:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851042.993665:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:2408:x1875746000751104:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 172us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851042.993678:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00010000:00010000:2.0:1788851042.995739:0:13203:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851042.995780:0:13203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851042.995786:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433c600/0x3e0030720b205a47 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851043.508255:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851044.082460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851044.082495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851044.082555:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851044.082576:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851044.084994:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851044.085264:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751360 00000100:00100000:3.0:1788851044.085282:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751360 00000100:00100000:3.0:1788851044.085339:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751616 00000100:00100000:3.0:1788851044.085342:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751616 00000100:00100000:3.0:1788851044.085360:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751488 00000100:00100000:3.0:1788851044.085363:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751488 00000100:00100000:3.0:1788851044.085378:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:3.0:1788851044.085387:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000751360:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851044.085465:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000751360:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 79us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.085473:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:3.0:1788851044.085488:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:3.0:1788851044.085494:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000751616:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851044.085515:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000751616:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.085520:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:3.0:1788851044.085530:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:3.0:1788851044.085536:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000751488:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851044.085558:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000751488:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.085580:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:3.0:1788851044.085599:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751232 00000100:00100000:3.0:1788851044.085603:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751232 00000100:00100000:3.0:1788851044.085628:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00100000:3.0:1788851044.085634:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:2409:x1875746000751232:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851044.085656:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:2409:x1875746000751232:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.085667:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00080000:3.0:1788851044.085691:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788851044.085694:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851044.088048:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751744 00000100:00100000:3.0:1788851044.088061:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751744 00000100:00100000:3.0:1788851044.088130:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:3.0:1788851044.088139:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000751744:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851044.088216:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000751744:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 78us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.088224:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00080000:3.0:1788851044.088247:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851044.277606:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019709056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851044.277683:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851044.277791:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709056 00000100:00100000:3.0:1788851044.277800:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709056 00000100:00100000:3.0:1788851044.277865:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788851044.277876:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019709056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851044.277912:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788851044.277979:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019709056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.277986:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788851044.278211:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019709056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851044.465739:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851044.465849:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751872 00000100:00100000:2.0:1788851044.465871:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751872 00000100:00100000:2.0:1788851044.465936:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 318 00000100:00100000:2.0:1788851044.465955:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:6192:x1875746000751872:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851044.465973:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851044.465995:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c389c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.466060:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389c5 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.466073:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389c5 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.466081:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6c00, rc 0) 00000100:00100000:2.0:1788851044.466132:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000751872:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 180us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851044.466139:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 318 00000100:00100000:2.0:1788851044.470997:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851044.471215:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752000 00000100:00100000:3.0:1788851044.471225:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752000 00000100:00100000:3.0:1788851044.471280:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 319 00000100:00100000:3.0:1788851044.471291:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000752000:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851044.471442:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000752000:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 153us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.471462:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 319 00000100:00100000:1.0:1788851044.473188:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851044.473268:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752128 00000100:00100000:3.0:1788851044.473275:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752128 00000100:00100000:3.0:1788851044.473320:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 320 00000100:00100000:3.0:1788851044.473330:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000752128:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851044.473440:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000752128:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.473447:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 320 00000100:00100000:1.0:1788851044.488009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851044.488506:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752256 00000100:00100000:3.0:1788851044.488518:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752256 00000100:00100000:3.0:1788851044.488575:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 321 00000100:00100000:3.0:1788851044.488586:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000752256:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851044.488602:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851044.488620:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c389cc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.488651:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389cc expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.488663:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389cc expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.488672:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031a00, rc 0) 00000100:00100000:3.0:1788851044.488730:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000752256:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 146us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.488738:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 321 00000100:00100000:2.0:1788851044.490353:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851044.490448:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752384 00000100:00100000:1.0:1788851044.490456:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752384 00000100:00100000:1.0:1788851044.490504:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 322 00000100:00100000:1.0:1788851044.490512:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000752384:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851044.490695:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000752384:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 183us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851044.490703:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 322 00000100:00100000:2.0:1788851044.501354:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851044.501448:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752512 00000100:00100000:3.0:1788851044.501458:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752512 00000100:00100000:3.0:1788851044.501515:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 323 00000100:00100000:3.0:1788851044.501525:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000752512:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851044.501659:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000752512:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 133us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.501667:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 323 00010000:00010000:3.0:1788851044.532148:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788851044.597249:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788851044.597258:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea7c1e800 from 7 10000000:01000000:3.0:1788851044.597261:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788851044.597312:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.597324:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.597334:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851044.597359:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788851044.597423:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851044.597477:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851044.598050:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709184 00000100:00100000:0.0:1788851044.598060:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709184 00000100:00100000:0.0:1788851044.598111:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788851044.598120:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019709184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851044.598134:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851044.598147:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205a5c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.598171:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205a5c expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.598182:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a5c expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.598191:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433c200, rc 0) 00000100:00100000:0.0:1788851044.598243:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019709184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851044.598249:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788851044.598469:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851044.598483:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.598493:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851044.598569:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851044.598598:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851044.598651:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851044.603771:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709312 00000100:00100000:2.0:1788851044.603785:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709312 00000100:00100000:3.0:1788851044.604707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788851044.604717:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019709312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851044.604886:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019709312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (6286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.604893:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788851044.605070:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851044.605124:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851044.605173:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851044.605201:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851044.605217:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709440 00000100:00100000:3.0:1788851044.605222:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709440 00000100:00100000:3.0:1788851044.605239:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788851044.605244:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019709440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851044.605314:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019709440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.605320:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788851044.605353:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788851044.607155:0:13265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788851044.608586:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788851044.608616:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788851044.608629:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.608656:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851044.608667:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851044.608669:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea5900800 from 7 10000000:01000000:0.0:1788851044.608672:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851044.608709:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.608716:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.608727:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851044.608750:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851044.608814:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851044.608861:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead739300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851044.609084:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709568 00000100:00100000:3.0:1788851044.609092:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709568 00000100:00100000:3.0:1788851044.609147:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788851044.609156:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019709568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851044.609170:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851044.609182:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205a6a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.609204:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205a6a expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.609214:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a6a expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.609222:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031e00, rc 0) 00000100:00100000:3.0:1788851044.609257:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019709568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.609263:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788851044.609492:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851044.609509:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.609518:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851044.609569:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851044.609594:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851044.609621:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead739300 going to sleep for 11 seconds 00000100:00100000:0.0:1788851044.609634:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709696 00000100:00100000:0.0:1788851044.609637:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709696 00000100:00100000:0.0:1788851044.609659:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788851044.609665:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019709696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851044.609754:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019709696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851044.609760:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788851044.609782:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851044.609803:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851044.609837:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851044.609907:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead739300 going to sleep for 11 seconds 00000100:00100000:0.0:1788851044.609928:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709824 00000100:00100000:0.0:1788851044.609931:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709824 00000100:00100000:0.0:1788851044.610004:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788851044.610009:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019709824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851044.610093:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019709824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851044.610100:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788851044.610135:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788851044.610726:0:13266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788851044.610775:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788851044.610789:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788851044.610797:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.610818:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851044.610828:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851044.610830:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ebbbf6000 from 7 10000000:01000000:0.0:1788851044.610833:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851044.611379:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.611390:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851044.611400:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851044.611418:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851044.611466:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851044.611538:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead739780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851044.614470:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709952 00000100:00100000:2.0:1788851044.614484:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709952 00000100:00100000:3.0:1788851044.614581:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788851044.614592:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019709952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851044.614608:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851044.614625:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205a78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.614653:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205a78 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.614664:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a78 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851044.614672:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030c00, rc 0) 00000100:00100000:3.0:1788851044.614756:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019709952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851044.614762:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788851044.614841:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019709952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851044.614869:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.614878:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851044.615099:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.615130:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851044.615160:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993900 going to sleep for 11 seconds 00000100:00100000:0.0:1788851044.615370:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710080 00000100:00100000:0.0:1788851044.615376:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710080 00000100:00100000:0.0:1788851044.615605:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788851044.615615:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019710080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851044.615726:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019710080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851044.615733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788851044.615827:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.615867:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.615906:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851044.615933:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993900 going to sleep for 11 seconds 00000100:00100000:2.0:1788851044.615954:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710208 00000100:00100000:2.0:1788851044.615958:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710208 00000100:00100000:2.0:1788851044.615979:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788851044.615984:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019710208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.616083:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019710208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851044.616089:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788851044.616127:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788851044.616754:0:13268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788851044.616810:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788851044.616832:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851044.616840:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.616849:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851044.616858:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788851044.616861:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e91596800 from 7 10000000:01000000:2.0:1788851044.616864:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851044.616887:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.616894:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.616902:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851044.616927:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.616960:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851044.616976:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851044.616988:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710336 00000100:00100000:2.0:1788851044.616992:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710336 00000100:00100000:2.0:1788851044.617036:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788851044.617044:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019710336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851044.617053:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851044.617072:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205a86 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.617093:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205a86 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.617103:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a86 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.617110:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6200, rc 0) 00000100:00100000:2.0:1788851044.617140:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019710336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851044.617146:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788851044.617179:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851044.617190:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.617198:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851044.617237:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.617260:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851044.617271:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851044.617280:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710464 00000100:00100000:2.0:1788851044.617283:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710464 00000100:00100000:2.0:1788851044.617298:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788851044.617304:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019710464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.617378:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019710464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851044.617389:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788851044.617414:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.617434:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.617462:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851044.617472:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851044.617481:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710592 00000100:00100000:2.0:1788851044.617485:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710592 00000100:00100000:2.0:1788851044.617501:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788851044.617506:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019710592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851044.617565:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019710592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851044.617571:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788851044.617603:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019710592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788851044.621620:0:13269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788851044.621795:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788851044.621817:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851044.621827:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851044.621839:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851045.556368:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851046.326970:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019710720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851046.327137:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851046.327267:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710720 00000100:00100000:1.0:1788851046.327275:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710720 00000100:00100000:1.0:1788851046.327335:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788851046.327346:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019710720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851046.327372:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851046.327414:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019710720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851046.327421:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788851046.327443:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788851046.327525:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c57100 x1875746019710720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851046.327556:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019710720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851046.327574:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851046.327580:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019710848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851046.327607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851046.328150:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710848 00000100:00100000:1.0:1788851046.328156:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710848 00000100:00100000:1.0:1788851046.328306:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788851046.328316:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019710848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851046.328336:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851046.328379:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019710848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851046.328384:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1788851046.328413:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd5f80 x1875746019710848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851046.328429:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019710848:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788851046.328453:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851046.329453:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019710976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851046.329510:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851046.329538:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019711488:0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.329560:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851046.329578:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019712000:0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.329599:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851046.329807:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019711232:0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.329845:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851046.329876:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019711744:0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.329914:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851046.329932:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019712256:0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.329951:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851046.329972:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788851046.329977:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019711360:0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.329997:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851046.330031:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019711872:0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.330377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019712512:0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.330404:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851046.330423:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788851046.330429:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019711104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851046.330448:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851046.330463:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019711616:0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.330478:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851046.330492:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019712128:0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.330505:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851046.330533:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711488 00000100:00100000:0.0:1788851046.330539:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711488 00000100:00100000:0.0:1788851046.330571:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711744 00000100:00100000:0.0:1788851046.330573:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711744 00000100:00100000:0.0:1788851046.330584:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788851046.330591:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019711488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.330737:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851046.330760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019712384:0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.330783:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851046.330804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711232 00000100:00100000:1.0:1788851046.330808:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711232 00000100:00100000:1.0:1788851046.330836:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788851046.330842:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019711232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851046.331107:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712512 00000100:00100000:2.0:1788851046.331112:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712512 00000100:00100000:2.0:1788851046.331152:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712128 00000100:00100000:2.0:1788851046.331155:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712128 00000100:00100000:2.0:1788851046.331175:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788851046.331182:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019712512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851046.331222:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019712512:12345-0@lo:400:kworker.0 Request processed in 41us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851046.331228:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788851046.331415:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019711232:12345-0@lo:400:kworker.0 Request processed in 36us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851046.331422:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788851046.331457:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712000 00000100:00100000:1.0:1788851046.331461:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712000 00000100:00100000:1.0:1788851046.331482:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712256 00000100:00100000:1.0:1788851046.331485:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712256 00000100:00100000:1.0:1788851046.331498:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711360 00000100:00100000:1.0:1788851046.331508:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711360 00000100:00100000:1.0:1788851046.331523:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711616 00000100:00100000:1.0:1788851046.331525:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711616 00000100:00100000:1.0:1788851046.331536:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711872 00000100:00100000:1.0:1788851046.331538:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711872 00000100:00100000:1.0:1788851046.331549:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712384 00000100:00100000:1.0:1788851046.331551:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712384 00000100:00100000:1.0:1788851046.331563:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788851046.331569:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019712000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.331603:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019712000:12345-0@lo:400:kworker.0 Request processed in 34us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851046.331823:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019711488:12345-0@lo:400:kworker.0 Request processed in 1231us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851046.331831:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788851046.331847:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788851046.331854:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019711744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.331907:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019711744:12345-0@lo:400:kworker.0 Request processed in 54us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851046.331912:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788851046.331993:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788851046.332037:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788851046.332046:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019712256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851046.332096:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788851046.332105:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019712128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851046.332137:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019712128:12345-0@lo:400:kworker.0 Request processed in 35us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851046.332142:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788851046.332143:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788851046.332150:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019711360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.332281:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019712256:12345-0@lo:400:kworker.0 Request processed in 237us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851046.332288:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788851046.332301:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788851046.332307:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019711616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.332335:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019711616:12345-0@lo:400:kworker.0 Request processed in 29us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851046.332341:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788851046.332353:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788851046.332359:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019711872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.332388:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019711872:12345-0@lo:400:kworker.0 Request processed in 29us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851046.332394:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788851046.332406:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788851046.332412:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019712384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.332438:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019712384:12345-0@lo:400:kworker.0 Request processed in 27us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851046.332443:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788851046.332492:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019711616:0@lo:400:kworker.0 00010000:00080000:0.0:1788851046.332517:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca3800 x1875746019712128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851046.332528:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019712128:0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.332539:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019711488:0@lo:400:kworker.0 00010000:00080000:0.0:1788851046.332548:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca1180 x1875746019712000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851046.332556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019712000:0@lo:400:kworker.0 00010000:00080000:0.0:1788851046.332566:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b76d80 x1875746019712512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851046.332573:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019712512:0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.332606:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710976 00000100:00100000:1.0:1788851046.332722:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019711360:12345-0@lo:400:kworker.0 Request processed in 573us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851046.332729:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1788851046.332760:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851046.332764:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851046.332768:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851046.332770:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851046.332789:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019711360:0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.332798:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019711872:0@lo:400:kworker.0 00010000:00080000:1.0:1788851046.332807:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca1500 x1875746019712384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851046.332815:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019712384:0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.332824:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019711232:0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.332840:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019711744:0@lo:400:kworker.0 00000100:00100000:1.0:1788851046.332848:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019712256:0@lo:400:kworker.0 00000100:00100000:0.0:1788851046.333584:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710976 00000100:00100000:0.0:1788851046.333739:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711104 00000100:00100000:0.0:1788851046.333744:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711104 00000100:00100000:1.0:1788851046.333782:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788851046.333791:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019710976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851046.333810:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851046.333871:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019710976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851046.333885:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788851046.333901:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788851046.333907:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019711104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851046.333917:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851046.333943:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019711104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851046.333948:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788851046.334118:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ab6300 x1875746019711104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851046.334136:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019711104:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788851046.334147:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ab4000 x1875746019710976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851046.334163:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019710976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788851046.580185:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788851046.759909:0:13401:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788851047.348369:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851047.348393:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019712640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851047.348466:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851047.348739:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712640 00000100:00100000:3.0:1788851047.348747:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712640 00000100:00100000:3.0:1788851047.348809:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788851047.348819:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019712640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851047.348854:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851047.348925:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019712640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851047.348932:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788851047.349193:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019712640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851047.606192:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851048.628953:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851049.203708:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851049.203743:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851049.203781:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851049.203813:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851049.203955:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752896 00000100:00100000:1.0:1788851049.203965:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752896 00000100:00100000:1.0:1788851049.204043:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753152 00000100:00100000:1.0:1788851049.204046:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753152 00000100:00100000:1.0:1788851049.204065:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752768 00000100:00100000:1.0:1788851049.204068:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752768 00000100:00100000:1.0:1788851049.204084:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:1.0:1788851049.204094:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000752896:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851049.204180:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000752896:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 87us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851049.204187:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:1.0:1788851049.204218:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 200 00000100:00100000:1.0:1788851049.204224:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000753152:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851049.204248:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000753152:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851049.204253:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 200 00000100:00100000:1.0:1788851049.204261:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 201 00000100:00100000:1.0:1788851049.204267:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000752768:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851049.204286:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000752768:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 20us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851049.204291:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 201 00000100:00080000:1.0:1788851049.204306:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851049.204310:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851049.204945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851049.205038:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753024 00000100:00100000:0.0:1788851049.205044:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753024 00000100:00100000:0.0:1788851049.205091:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 202 00000100:00100000:0.0:1788851049.205099:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000753024:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851049.205152:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000753024:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 53us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851049.205158:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 202 00000100:00100000:3.0:1788851049.205510:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752640 00000100:00100000:3.0:1788851049.205516:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752640 00000100:00100000:3.0:1788851049.205560:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 337 00000100:00100000:3.0:1788851049.205568:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000752640:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851049.205599:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000752640:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851049.205606:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 337 00000100:00080000:2.0:1788851049.205932:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851049.398370:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019712768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851049.398444:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851049.398949:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712768 00000100:00100000:3.0:1788851049.398958:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712768 00000100:00100000:3.0:1788851049.399037:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788851049.399046:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019712768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851049.399078:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788851049.399982:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019712768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 933us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851049.400037:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788851049.400561:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019712768:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788851049.652358:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851050.677617:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851051.444318:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851051.444344:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019712896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851051.444411:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851051.444528:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712896 00000100:00100000:1.0:1788851051.444538:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712896 00000100:00100000:1.0:1788851051.444598:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788851051.444608:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019712896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851051.444637:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851051.444684:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019712896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851051.444692:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788851051.444982:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019713024:0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445056:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851051.445088:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019713536:0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445111:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851051.445126:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019714048:0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445146:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851051.445162:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788851051.445167:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019713152:0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445188:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851051.445204:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019713664:0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445222:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851051.445236:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019714176:0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445253:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851051.445277:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713152 00000100:00100000:1.0:1788851051.445281:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713152 00000100:00100000:1.0:1788851051.445306:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713664 00000100:00100000:1.0:1788851051.445309:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713664 00000100:00100000:1.0:1788851051.445325:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714176 00000100:00100000:1.0:1788851051.445328:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714176 00000100:00100000:1.0:1788851051.445340:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788851051.445346:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019713152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445381:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019713152:12345-0@lo:400:kworker.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851051.445388:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788851051.445400:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788851051.445406:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019713664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445430:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019713664:12345-0@lo:400:kworker.0 Request processed in 25us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851051.445441:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788851051.445451:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788851051.445456:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019714176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445478:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019714176:12345-0@lo:400:kworker.0 Request processed in 22us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851051.445483:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788851051.445517:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019713152:0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445526:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019713664:0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.445532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019714176:0@lo:400:kworker.0 00000100:00080000:0.0:1788851051.445617:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851051.445622:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851051.445639:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713536 00000100:00100000:0.0:1788851051.445643:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713536 00000100:00100000:0.0:1788851051.445680:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788851051.445686:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019713536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.445724:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019713536:12345-0@lo:400:kworker.0 Request processed in 38us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851051.445730:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788851051.445768:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019713280:0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.445804:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851051.445819:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019713792:0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.445839:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851051.445855:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019714304:0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.445871:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788851051.445894:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8748b480 x1875746019712896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851051.445909:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019712896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851051.445922:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788851051.445927:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019713408:0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.445948:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851051.445964:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019713920:0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.445994:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851051.446009:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019714432:0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446051:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851051.446076:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714048 00000100:00100000:0.0:1788851051.446081:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714048 00000100:00100000:0.0:1788851051.446110:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713920 00000100:00100000:0.0:1788851051.446113:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713920 00000100:00100000:0.0:1788851051.446125:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714432 00000100:00100000:0.0:1788851051.446128:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714432 00000100:00100000:0.0:1788851051.446139:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788851051.446145:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019714048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446173:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019714048:12345-0@lo:400:kworker.0 Request processed in 29us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851051.446178:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788851051.446188:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788851051.446194:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019713920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446220:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019713920:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851051.446225:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788851051.446234:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788851051.446240:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019714432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446264:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019714432:12345-0@lo:400:kworker.0 Request processed in 25us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851051.446270:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788851051.446287:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713792 00000100:00100000:0.0:1788851051.446290:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713792 00000100:00100000:0.0:1788851051.446309:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714304 00000100:00100000:0.0:1788851051.446318:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714304 00000100:00100000:0.0:1788851051.446336:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713408 00000100:00100000:0.0:1788851051.446338:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713408 00000100:00100000:0.0:1788851051.446349:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788851051.446354:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019713792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446381:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019713792:12345-0@lo:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851051.446386:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788851051.446396:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788851051.446401:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019714304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446424:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019714304:12345-0@lo:400:kworker.0 Request processed in 23us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851051.446429:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788851051.446440:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788851051.446445:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019713408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446467:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019713408:12345-0@lo:400:kworker.0 Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851051.446472:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1788851051.446489:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851051.446492:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851051.446493:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851051.446499:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713280 00000100:00100000:0.0:1788851051.446502:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713280 00000100:00100000:0.0:1788851051.446515:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788851051.446520:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019713280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446546:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019713280:12345-0@lo:400:kworker.0 Request processed in 26us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851051.446561:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788851051.446589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019713536:0@lo:400:kworker.0 00010000:00080000:0.0:1788851051.446599:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e17480 x1875746019714048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851051.446607:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019714048:0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446630:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019713408:0@lo:400:kworker.0 00010000:00080000:0.0:1788851051.446640:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e15880 x1875746019713920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851051.446648:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019713920:0@lo:400:kworker.0 00010000:00080000:0.0:1788851051.446656:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e14380 x1875746019714432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851051.446662:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019714432:0@lo:400:kworker.0 00000100:00100000:0.0:1788851051.446669:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019713280:0@lo:400:kworker.0 00010000:00080000:0.0:1788851051.446677:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e17800 x1875746019713792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851051.446684:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019713792:0@lo:400:kworker.0 00010000:00080000:0.0:1788851051.446693:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e16300 x1875746019714304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851051.446699:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019714304:0@lo:400:kworker.0 00000100:00100000:2.0:1788851051.446959:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019714688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851051.446991:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851051.447027:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851051.447033:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019714560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851051.447053:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851051.447078:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714688 00000100:00100000:2.0:1788851051.447082:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714688 00000100:00100000:2.0:1788851051.447105:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714560 00000100:00100000:2.0:1788851051.447107:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714560 00000100:00100000:2.0:1788851051.447119:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788851051.447124:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019714688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788851051.447145:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851051.447176:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019714688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851051.447182:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788851051.447193:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788851051.447198:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019714560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851051.447215:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851051.447240:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019714560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851051.447246:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1788851051.447271:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ab5500 x1875746019714560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851051.447283:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019714560:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788851051.447291:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87ab4380 x1875746019714688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851051.447300:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019714688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851051.447382:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713024 00000100:00100000:3.0:1788851051.447388:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713024 00000100:00100000:3.0:1788851051.447425:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788851051.447432:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019713024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851051.447467:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019713024:12345-0@lo:400:kworker.0 Request processed in 36us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851051.447473:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788851051.448061:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019713024:0@lo:400:kworker.0 00000100:00100000:1.0:1788851051.448121:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019714816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851051.448155:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851051.448285:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714816 00000100:00100000:2.0:1788851051.448289:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714816 00000100:00100000:2.0:1788851051.448324:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788851051.448331:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019714816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851051.448343:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851051.448384:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019714816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851051.448391:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788851051.448987:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca3100 x1875746019714816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851051.449004:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019714816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851051.701358:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788851052.411392:0:13550:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:04:10 (1788851050) === 00000100:00100000:3.0:1788851052.468408:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019714944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851052.468483:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851052.468587:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714944 00000100:00100000:0.0:1788851052.468602:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714944 00000100:00100000:0.0:1788851052.468652:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788851052.468662:0:6540:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788851052.468662:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019714944:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851052.468670:0:6540:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:0.0:1788851052.468710:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851052.470264:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019714944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851052.470328:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019714944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1347us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851052.470339:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788851052.546116:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.546164:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.546217:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753408 00000100:00100000:0.0:1788851052.546227:0:6543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753408 00000100:00100000:2.0:1788851052.546240:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753280 00000100:00100000:2.0:1788851052.546244:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753280 00000100:00100000:2.0:1788851052.546284:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1788851052.546284:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:2.0:1788851052.546295:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000753280:12345-192.168.204.27@tcp:41:mkdir.0 00000100:00100000:0.0:1788851052.546295:0:6543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a99889d1-fa00-4984-a18e-0736ff414641+7:10535:x1875746000753408:12345-192.168.204.27@tcp:700:mkdir.0 00000004:00000024:2.0:1788851052.546332:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788851052.546374:0:6543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a99889d1-fa00-4984-a18e-0736ff414641+7:10535:x1875746000753408:12345-192.168.204.27@tcp:700:mkdir.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851052.546382:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:2.0:1788851052.546388:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000753280:12345-192.168.204.27@tcp:41:mkdir.0 Request processed in 95us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851052.546394:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00080000:0.0:1788851052.546403:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851052.551429:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.551549:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753664 00000100:00100000:0.0:1788851052.551559:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753664 00000100:00100000:0.0:1788851052.551610:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1788851052.551619:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+6:10535:x1875746000753664:12345-192.168.204.27@tcp:36:mkdir.0 00010000:00010000:0.0:1788851052.551675:0:10526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851052.551741:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205936 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38940 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.551767:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea55ec600) 00010000:00010000:0.0:1788851052.551778:0:10526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851052.551871:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.551885:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.551895:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.551922:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.551930:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.551937:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.552949:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.552961:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.552969:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851052.552983:0:10526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043ee78a2 reply state 00000000938a53f3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.552993:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.552999:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892d87409c00) 00010000:00010000:0.0:1788851052.553006:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851052.553050:0:10526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788851052.553057:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788851052.553065:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.553072:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.553078:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.553084:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851052.553088:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.553095:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.553104:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d87409500) 00010000:00010000:0.0:1788851052.553106:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851052.553109:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.553115:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205a94 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851052.553128:0:10526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043ee78a2 reply state 00000000938a53f3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.553135:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.553149:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff892d87409f00) 00010000:00010000:0.0:1788851052.553151:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851052.553152:0:10526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788851052.553978:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+7:10535:x1875746000753664:12345-192.168.204.27@tcp:36:mkdir.0 Request processed in 2354us (2556us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788851052.553988:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:1.0:1788851052.565872:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851052.565909:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753792 00000100:00100000:1.0:1788851052.565919:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753792 00000100:00100000:1.0:1788851052.565970:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:1.0:1788851052.565979:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:10536:x1875746000753792:12345-192.168.204.27@tcp:101:chmod.0 00010000:00010000:1.0:1788851052.566001:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851052.566042:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205aa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c389d3 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.566113:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205ab0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.566126:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.566138:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851052.566180:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788851052.566184:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851052.566220:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.566245:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205aa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389d3 expref: 9 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.566262:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389d3 expref: 8 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.566270:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d81099f00) 00010000:00010000:1.0:1788851052.566273:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851052.566277:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95c00, rc 0) 00000100:00100000:1.0:1788851052.566333:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+8:10536:x1875746000753792:12345-192.168.204.27@tcp:101:chmod.0 Request processed in 354us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851052.566340:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1788851052.574487:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851052.574571:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754048 00000100:00100000:1.0:1788851052.574583:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754048 00000100:00100000:1.0:1788851052.574660:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1788851052.574671:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:10536:x1875746000754048:12345-192.168.204.27@tcp:36:chmod.0 00010000:00010000:1.0:1788851052.574731:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851052.574769:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205ab0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389d3 expref: 8 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.574797:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d81099f00) 00010000:00010000:1.0:1788851052.574808:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851052.574834:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.574849:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.574859:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851052.575072:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082409ace reply state 00000000e44c60a6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.575086:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.575093:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d81099c00) 00010000:00010000:1.0:1788851052.575096:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788851052.575099:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788851052.575106:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788851052.575183:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+9:10536:x1875746000754048:12345-192.168.204.27@tcp:36:chmod.0 Request processed in 513us (704us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788851052.575190:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:2.0:1788851052.603096:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.603222:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754176 00000100:00100000:0.0:1788851052.603232:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754176 00000100:00100000:0.0:1788851052.603300:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:0.0:1788851052.603311:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+9:10537:x1875746000754176:12345-192.168.204.27@tcp:101:chown.0 00010000:00010000:0.0:1788851052.603375:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851052.603397:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c389da expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.603467:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b205ac5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.603481:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b205ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.603493:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b205ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851052.603537:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788851052.603541:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851052.603585:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b205ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.603612:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389da expref: 11 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.604405:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b205ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389da expref: 10 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.604417:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d81099c00) 00010000:00010000:0.0:1788851052.604420:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851052.604423:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eeba800, rc 0) 00000100:00100000:1.0:1788851052.604774:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+10:10537:x1875746000754176:12345-192.168.204.27@tcp:101:chown.0 Request processed in 1449us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851052.604783:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:1.0:1788851052.609112:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851052.609234:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754304 00000100:00100000:2.0:1788851052.609249:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754304 00000100:00100000:2.0:1788851052.609328:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1788851052.609340:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+10:10537:x1875746000754304:12345-192.168.204.27@tcp:101:chown.0 00010000:00010000:2.0:1788851052.609526:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851052.609546:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205acc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c389e1 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.609617:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.609632:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.609921:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.609941:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.609948:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.609955:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610120:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205ae1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610128:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610134:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851052.610230:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788851052.610235:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851052.610260:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610275:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610282:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610289:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610295:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851052.610299:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610307:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610320:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d81099c00) 00010000:00010000:2.0:1788851052.610329:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851052.610335:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610342:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205ad3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610421:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610428:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610433:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610438:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851052.610441:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610447:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610455:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff892d87409f00) 00010000:00010000:2.0:1788851052.610458:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851052.610461:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610467:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205ada lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610499:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205acc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389e1 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610526:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389e1 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.610533:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892d87409c00) 00010000:00010000:2.0:1788851052.610536:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851052.610538:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7c00, rc 0) 00000100:00100000:2.0:1788851052.610647:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+11:10537:x1875746000754304:12345-192.168.204.27@tcp:101:chown.0 Request processed in 1309us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851052.610655:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1788851052.613526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.614441:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754432 00000100:00100000:0.0:1788851052.614453:0:6546:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754432 00000100:00100000:0.0:1788851052.614512:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1788851052.614522:0:6546:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a99889d1-fa00-4984-a18e-0736ff414641+11:10537:x1875746000754432:12345-192.168.204.27@tcp:900:chown.0 00000100:00100000:0.0:1788851052.614917:0:6546:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a99889d1-fa00-4984-a18e-0736ff414641+11:10537:x1875746000754432:12345-192.168.204.27@tcp:900:chown.0 Request processed in 395us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851052.614927:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:2.0:1788851052.618072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851052.618459:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754688 00000100:00100000:3.0:1788851052.618470:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754688 00000100:00100000:3.0:1788851052.618529:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1788851052.618539:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+11:10537:x1875746000754688:12345-192.168.204.27@tcp:36:chown.0 00010000:00010000:3.0:1788851052.618589:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851052.618842:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205ae1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389e1 expref: 11 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.618867:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892d87409c00) 00010000:00010000:3.0:1788851052.618872:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851052.618898:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.618926:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.618937:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851052.622516:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788851052.622832:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622847:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622856:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622863:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851052.622867:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622875:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622899:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff892d87409f00) 00010000:00010000:0.0:1788851052.622903:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851052.622908:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622915:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205a9b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622935:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622942:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622948:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622954:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851052.622957:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622963:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622971:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892d87409c00) 00010000:00010000:0.0:1788851052.622973:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851052.622976:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.622982:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205aa2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.623007:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.623038:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.623045:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.623050:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851052.623053:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.623059:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.623067:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d81099c00) 00010000:00010000:0.0:1788851052.623069:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788851052.623073:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.623078:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205ab7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851052.624222:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9f4159e reply state 000000001605bcbc transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.624244:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.624254:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892d87409c00) 00010000:00010000:1.0:1788851052.624257:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788851052.624260:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788851052.624273:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788851052.624377:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788851052.624401:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:10537:x1875746000754688:12345-192.168.204.27@tcp:36:chown.0 Request processed in 5860us (6334us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788851052.624410:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00010000:00010000:3.0:1788851052.624573:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.624582:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.624589:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.624595:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851052.624598:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.624605:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.624628:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892d87409c00) 00010000:00010000:3.0:1788851052.624631:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851052.624634:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.624641:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ae8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851052.640873:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.641650:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754816 00000100:00100000:0.0:1788851052.641662:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754816 00000100:00100000:1.0:1788851052.641907:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:1.0:1788851052.641918:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+6:10538:x1875746000754816:12345-192.168.204.27@tcp:101:touch.500 00010000:00010000:1.0:1788851052.641941:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851052.641960:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205aef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c389e8 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851052.646116:0:10526:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3977us 00010000:00010000:3.0:1788851052.667571:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667593:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667606:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667621:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667628:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667635:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667780:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205b04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667789:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667797:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851052.667826:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788851052.667842:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851052.667880:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667905:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667912:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667920:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667927:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851052.667931:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667939:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667950:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d81099c00) 00010000:00010000:3.0:1788851052.667954:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851052.667958:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667965:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205af6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667977:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667984:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.667990:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.668001:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851052.668004:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.668043:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.668053:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff892e83031e00) 00010000:00010000:3.0:1788851052.668055:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851052.668058:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.668065:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205afd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.668105:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205aef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389e8 expref: 8 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.668120:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389e8 expref: 7 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.668128:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892e83031600) 00010000:00010000:3.0:1788851052.668130:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788851052.668133:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031600, rc 0) 00000100:00100000:3.0:1788851052.668203:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+7:10538:x1875746000754816:12345-192.168.204.27@tcp:101:touch.500 Request processed in 26286us (27339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851052.668213:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1788851052.682513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.682736:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755072 00000100:00100000:0.0:1788851052.682752:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755072 00000100:00100000:0.0:1788851052.682827:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1788851052.682840:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:10538:x1875746000755072:12345-192.168.204.27@tcp:101:touch.500 00010000:00010000:0.0:1788851052.682879:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851052.682901:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205b0b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c389ef expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683050:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683067:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683080:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683138:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683147:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683154:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788851052.683597:0:6535:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788851052.683779:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205b20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683789:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683797:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683844:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683851:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683858:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683865:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851052.683870:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683877:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683889:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892e83031600) 00010000:00010000:0.0:1788851052.683892:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851052.683897:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683902:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851052.683915:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000744b2706 reply state 0000000009cd620e transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683927:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683933:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1fc305e7 (ffff892d87409f00) 00010000:00010000:0.0:1788851052.683940:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851052.683943:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788851052.683976:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205b0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389ef expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683992:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205b20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389ef expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.683999:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff892d87409500) 00010000:00010000:0.0:1788851052.684001:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851052.684003:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433c600, rc 0) 00000100:00100000:0.0:1788851052.684105:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+10:10538:x1875746000755072:12345-192.168.204.27@tcp:101:touch.500 Request processed in 1267us (1605us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788851052.684114:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:2.0:1788851052.697281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851052.697365:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755328 00000100:00100000:1.0:1788851052.697375:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755328 00000100:00100000:1.0:1788851052.697430:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:1.0:1788851052.697440:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+10:10538:x1875746000755328:12345-192.168.204.27@tcp:36:touch.500 00010000:00010000:1.0:1788851052.697506:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851052.697533:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c600/0x3e0030720b205b20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389ef expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.697552:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff892d87409500) 00010000:00010000:1.0:1788851052.697563:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851052.697617:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.697630:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.697640:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851052.697771:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d12ffda9 reply state 000000004364cadf transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.697794:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.697802:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff892d8797da00) 00010000:00010000:1.0:1788851052.697805:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788851052.697808:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851052.697898:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+11:10538:x1875746000755328:12345-192.168.204.27@tcp:36:touch.500 Request processed in 458us (626us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788851052.697906:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1788851052.700641:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851052.700728:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755456 00000100:00100000:3.0:1788851052.700751:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755456 00000100:00100000:3.0:1788851052.700820:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1788851052.700829:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+11:10538:x1875746000755456:12345-192.168.204.27@tcp:101:touch.500 00010000:00010000:3.0:1788851052.700851:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851052.700870:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205b35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c389f6 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.700931:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205b35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389f6 expref: 12 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.700945:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205b35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389f6 expref: 12 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851052.700962:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff892d8797da00) 00010000:00010000:3.0:1788851052.700965:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851052.700969:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031400, rc 0) 00000100:00100000:3.0:1788851052.701313:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+12:10538:x1875746000755456:12345-192.168.204.27@tcp:101:touch.500 Request processed in 483us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851052.701320:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:2.0:1788851052.704409:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.704491:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755584 00000100:00100000:0.0:1788851052.704503:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755584 00000100:00100000:0.0:1788851052.704547:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1788851052.704554:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1875746000755584:12345-192.168.204.27@tcp:8:touch.500 00010000:00080000:0.0:1788851052.704589:0:8625:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:0.0:1788851052.704620:0:8625:0:(genops.c:1384:class_connect()) connect: client a99889d1-fa00-4984-a18e-0736ff414641, cookie 0x3e0030720b205b3c 00002000:00100000:0.0:1788851052.704633:0:8625:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a99889d1-fa00-4984-a18e-0736ff414641/ffff892ea7cac800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788851052.704645:0:8625:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788851052.704736:0:8625:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788851052.704775:0:8625:0:(import.c:65:import_set_state_nolock()) ffff892ea7caf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851052.704852:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2406:x1875746000755584:12345-192.168.204.27@tcp:8:touch.500 Request processed in 296us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851052.704859:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1788851052.709191:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.709288:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755712 00000100:00100000:0.0:1788851052.709297:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755712 00000100:00100000:0.0:1788851052.709366:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1788851052.709375:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:0:x1875746000755712:12345-192.168.204.27@tcp:2:touch.500 00000100:00080000:2.0:1788851052.709664:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788851052.717255:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1788851052.717272:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000100:00100000:0.0:1788851052.717497:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:0:x1875746000755712:12345-192.168.204.27@tcp:2:touch.500 Request processed in 8116us (8308us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788851052.717509:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:2.0:1788851052.723666:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.723886:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755968 00000100:00100000:0.0:1788851052.723896:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755968 00000100:00100000:0.0:1788851052.723987:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1788851052.723997:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+12:10538:x1875746000755968:12345-192.168.204.27@tcp:35:touch.500 00000100:00100000:0.0:1788851052.724298:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+13:10538:x1875746000755968:12345-192.168.204.27@tcp:35:touch.500 Request processed in 302us (645us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788851052.724306:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00010000:00010000:3.0:1788851052.729134:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851052.744562:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851052.744675:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756096 00000100:00100000:1.0:1788851052.744686:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756096 00000100:00100000:1.0:1788851052.744764:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:1.0:1788851052.744789:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+13:10539:x1875746000756096:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:1.0:1788851052.744814:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851052.744832:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205b43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c389fd expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.744890:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205b4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.744904:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205b4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.744917:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205b4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851052.744962:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788851052.744965:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851052.745050:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205b4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.745078:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205b43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389fd expref: 15 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.745096:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205b4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389fd expref: 14 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.745104:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892e83031600) 00010000:00010000:1.0:1788851052.745106:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851052.745110:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94000, rc 0) 00000100:00100000:1.0:1788851052.745164:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+14:10539:x1875746000756096:12345-192.168.204.27@tcp:101:rm.0 Request processed in 386us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851052.745178:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1788851052.761996:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.764923:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756352 00000100:00100000:0.0:1788851052.764939:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756352 00000100:00100000:0.0:1788851052.765037:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:0.0:1788851052.765047:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+14:10539:x1875746000756352:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:0.0:1788851052.765067:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851052.765086:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a04 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851052.765182:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788851052.765286:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a04 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.765319:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d81099c00) 00010000:00010000:0.0:1788851052.765322:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851052.765327:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b205b51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a04 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.765340:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d400, rc 0) 00000100:00100000:0.0:1788851052.765508:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+15:10539:x1875746000756352:12345-192.168.204.27@tcp:101:rm.0 Request processed in 462us (3522us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1788851052.765515:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1788851052.775282:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851052.775358:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756480 00000100:00100000:0.0:1788851052.775367:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756480 00000100:00100000:0.0:1788851052.775420:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1788851052.775429:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+15:10539:x1875746000756480:12345-192.168.204.27@tcp:37:rm.0 00000100:00100000:1.0:1788851052.782148:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+15:10539:x1875746000756480:12345-192.168.204.27@tcp:37:rm.0 Request processed in 6704us (6860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851052.782172:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1788851052.791494:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851052.791914:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756736 00000100:00100000:1.0:1788851052.791925:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756736 00000100:00100000:1.0:1788851052.791986:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:1.0:1788851052.791996:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ec1c5c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+15:10539:x1875746000756736:12345-192.168.204.27@tcp:35:rm.0 00000100:00100000:1.0:1788851052.793068:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ec1c5c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+16:10539:x1875746000756736:12345-192.168.204.27@tcp:35:rm.0 Request processed in 1070us (1581us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788851052.793079:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:3.0:1788851052.798110:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851052.800997:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756992 00000100:00100000:2.0:1788851052.801023:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756992 00000100:00100000:2.0:1788851052.801104:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:2.0:1788851052.801113:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+16:10539:x1875746000756992:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:2.0:1788851052.801133:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851052.801152:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205b5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a0b expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.801248:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205b66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.801261:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205b66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.801273:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205b66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851052.801282:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788851052.801377:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205b5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a0b expref: 19 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.801395:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205b66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a0b expref: 18 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.801404:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892e83031600) 00010000:00010000:2.0:1788851052.801407:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851052.801410:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6000, rc 0) 00000100:00100000:2.0:1788851052.804198:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+18:10539:x1875746000756992:12345-192.168.204.27@tcp:101:rm.0 Request processed in 3073us (6086us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788851052.804212:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:3.0:1788851052.806558:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851052.806649:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757120 00000100:00100000:1.0:1788851052.806659:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757120 00000100:00100000:1.0:1788851052.806727:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:1.0:1788851052.806737:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+18:10539:x1875746000757120:12345-192.168.204.27@tcp:41:rm.0 00000004:00000024:1.0:1788851052.806811:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1788851052.811063:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+18:10539:x1875746000757120:12345-192.168.204.27@tcp:41:rm.0 Request processed in 4313us (4500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851052.811080:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:3.0:1788851052.815579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851052.815714:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757248 00000100:00100000:2.0:1788851052.815735:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757248 00000100:00100000:2.0:1788851052.815809:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:2.0:1788851052.815820:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+18:10539:x1875746000757248:12345-192.168.204.27@tcp:101:rm.0 00010000:00010000:2.0:1788851052.815838:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851052.815860:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205b74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a12 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.815921:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.815936:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.815948:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.815959:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.815968:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.815975:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816127:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205b89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816137:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816144:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851052.816186:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788851052.816190:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851052.816209:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816222:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205b89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816230:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816237:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816245:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816251:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851052.816256:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816263:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816275:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892e83031600) 00010000:00010000:2.0:1788851052.816278:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851052.816283:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816290:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205b7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816312:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816319:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816326:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816331:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851052.816334:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816341:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816348:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1fc305e7 (ffff892d87409f00) 00010000:00010000:2.0:1788851052.816351:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851052.816354:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816360:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b205b82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816383:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b205b74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a12 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816396:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205b89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a12 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.816413:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff892d8797da00) 00010000:00010000:2.0:1788851052.816416:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851052.816418:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7600, rc 0) 00000100:00100000:2.0:1788851052.816480:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:10539:x1875746000757248:12345-192.168.204.27@tcp:101:rm.0 Request processed in 662us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851052.816487:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:2.0:1788851052.821246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851052.824149:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757504 00000100:00100000:3.0:1788851052.824163:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757504 00000100:00100000:2.0:1788851052.827404:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:2.0:1788851052.827417:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+19:10539:x1875746000757504:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:2.0:1788851052.827469:0:10526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788851052.827493:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205b89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a12 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827516:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205b35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389f6 expref: 18 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827529:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff892d8797da00) 00010000:00010000:2.0:1788851052.827538:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205b4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389fd expref: 17 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827547:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892e83031600) 00010000:00010000:2.0:1788851052.827550:0:10526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851052.827571:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827585:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827609:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827620:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827626:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827633:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827719:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827727:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.827734:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788851052.827959:0:10526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788851052.827967:0:10526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386886954203ns, next at 387886952407ns, rc = 0 00010000:00010000:2.0:1788851052.828003:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.828134:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.828143:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.828160:0:10526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.828167:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851052.828173:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828349:0:10526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851052.828370:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828377:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828392:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828398:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2154800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851052.828402:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828410:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828420:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff892d8797da00) 00010000:00010000:1.0:1788851052.828422:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788851052.828426:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828432:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205b9e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828448:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828454:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828460:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828465:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851052.828468:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828481:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828488:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892e83031600) 00010000:00010000:1.0:1788851052.828489:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851052.828492:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828498:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205b90 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851052.828506:0:10526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce071a44 reply state 000000002bd9210d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828517:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.828522:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1fc305e7 (ffff892d87409f00) 00010000:00010000:1.0:1788851052.828524:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788851052.828527:0:10526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788851052.828663:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851052.828670:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.828676:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2155a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851052.828679:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.828686:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.828695:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff892d8797da00) 00010000:00010000:0.0:1788851052.828697:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788851052.828700:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.828712:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155a00/0x3e0030720b205ba5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851052.828724:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851052.828725:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851052.828727:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851052.828771:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+18:10539:x1875746000757504:12345-192.168.204.27@tcp:36:rm.0 Request processed in 1353us (7531us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788851052.828780:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:0.0:1788851052.833491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851052.833562:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757760 00000100:00100000:3.0:1788851052.833586:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757760 00000100:00100000:3.0:1788851052.833643:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1788851052.833663:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+18:10539:x1875746000757760:12345-192.168.204.27@tcp:35:rm.0 00000100:00100000:3.0:1788851052.833968:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+19:10539:x1875746000757760:12345-192.168.204.27@tcp:35:rm.0 Request processed in 306us (485us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788851052.833976:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1788851052.837374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851052.837449:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758016 00000100:00100000:1.0:1788851052.837457:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758016 00000100:00100000:1.0:1788851052.837516:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:1.0:1788851052.837526:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+19:10539:x1875746000758016:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:1.0:1788851052.837579:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788851052.837603:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205b66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a0b expref: 19 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837639:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205b04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389e8 expref: 18 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837664:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892e83031600) 00010000:00010000:1.0:1788851052.837680:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b205ac5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389da expref: 17 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837691:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d81099c00) 00010000:00010000:1.0:1788851052.837698:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851052.837722:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837735:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837745:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837768:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837777:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837784:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837883:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837901:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.837908:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851052.838150:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788851052.838164:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838172:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838179:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838184:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851052.838189:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838196:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838204:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff892d8797d600) 00010000:00010000:1.0:1788851052.838207:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788851052.838211:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838217:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205bba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838232:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838243:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838249:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838254:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851052.838257:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838263:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838269:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892d8797d000) 00010000:00010000:1.0:1788851052.838271:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851052.838274:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838279:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205bac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851052.838288:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038253875 reply state 00000000ebe66452 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838297:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851052.838303:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff892d8797d300) 00010000:00010000:1.0:1788851052.838305:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788851052.838308:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851052.838375:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+18:10539:x1875746000758016:12345-192.168.204.27@tcp:36:rm.0 Request processed in 851us (1010us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788851052.838387:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00010000:00010000:0.0:1788851053.748408:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851054.325917:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851054.325962:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851054.325987:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851054.326024:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851054.326050:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851054.326078:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851054.326108:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758400 00000100:00100000:1.0:1788851054.326120:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758400 00000100:00100000:1.0:1788851054.326180:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758656 00000100:00100000:1.0:1788851054.326183:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758656 00000100:00100000:1.0:1788851054.326200:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758272 00000100:00100000:1.0:1788851054.326203:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758272 00000100:00100000:1.0:1788851054.326218:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758784 00000100:00100000:1.0:1788851054.326221:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758784 00000100:00100000:1.0:1788851054.326238:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 209 00000100:00100000:1.0:1788851054.326249:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000758400:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851054.326322:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000758400:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851054.326330:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 209 00000100:00100000:1.0:1788851054.326347:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 210 00000100:00100000:1.0:1788851054.326353:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000758656:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851054.326377:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000758656:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851054.326383:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 210 00000100:00100000:1.0:1788851054.326393:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 211 00000100:00100000:1.0:1788851054.326409:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+18:2409:x1875746000758272:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851054.326437:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+18:2409:x1875746000758272:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851054.326442:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 211 00000100:00100000:1.0:1788851054.326453:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 212 00000100:00100000:1.0:1788851054.326459:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000758784:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851054.326479:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000758784:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 20us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851054.326485:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 212 00000100:00100000:1.0:1788851054.326505:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758528 00000100:00100000:1.0:1788851054.326509:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758528 00000100:00100000:1.0:1788851054.326535:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:1.0:1788851054.326541:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000758528:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851054.326563:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000758528:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851054.326569:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00080000:2.0:1788851054.327335:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851054.327342:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851054.327344:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851054.328431:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758144 00000100:00100000:3.0:1788851054.328442:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758144 00000100:00100000:3.0:1788851054.328495:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 339 00000100:00100000:3.0:1788851054.328504:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000758144:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851054.328565:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000758144:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 63us (2660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851054.328572:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 339 00000100:00100000:2.0:1788851054.516931:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019715072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851054.517042:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851054.517212:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715072 00000100:00100000:1.0:1788851054.517229:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715072 00000100:00100000:1.0:1788851054.517288:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788851054.517298:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019715072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851054.517345:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788851054.517401:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019715072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851054.517408:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788851054.517551:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019715072:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788851054.772204:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851055.797256:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851056.567309:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019715200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851056.567382:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851056.567462:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019715328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851056.567487:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851056.567511:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851056.567518:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019715456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851056.567538:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851056.567565:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715200 00000100:00100000:2.0:1788851056.567572:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715200 00000100:00100000:2.0:1788851056.567615:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715328 00000100:00100000:2.0:1788851056.567618:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715328 00000100:00100000:2.0:1788851056.567631:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715456 00000100:00100000:2.0:1788851056.567633:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715456 00000100:00100000:2.0:1788851056.567692:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788851056.567701:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019715200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851056.567732:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851056.567774:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019715200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851056.567780:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788851056.567795:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788851056.567801:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019715328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788851056.567816:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851056.567848:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019715328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851056.567854:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788851056.567866:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788851056.567871:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019715456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851056.567879:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851056.567899:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019715456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851056.567904:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788851056.567926:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851056.567929:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788851056.567953:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c35f80 x1875746019715200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851056.567971:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019715200:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788851056.567999:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c35880 x1875746019715456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851056.568046:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019715456:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788851056.568058:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c36d80 x1875746019715328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851056.568068:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019715328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851056.570740:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019715584:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.570826:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851056.570865:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019716096:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.570892:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851056.570910:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019716608:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.570934:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851056.570958:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788851056.570964:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019715712:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.570986:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851056.571002:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019716224:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571042:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851056.571057:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019716736:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571076:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851056.571104:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715584 00000100:00100000:1.0:1788851056.571112:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715584 00000100:00100000:1.0:1788851056.571160:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788851056.571168:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019715584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571213:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019715584:12345-0@lo:400:kworker.0 Request processed in 46us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851056.571221:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788851056.571252:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716096 00000100:00100000:1.0:1788851056.571256:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716096 00000100:00100000:1.0:1788851056.571279:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788851056.571285:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019716096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571318:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019716096:12345-0@lo:400:kworker.0 Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851056.571334:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788851056.571353:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716608 00000100:00100000:1.0:1788851056.571356:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716608 00000100:00100000:1.0:1788851056.571389:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715712 00000100:00100000:1.0:1788851056.571392:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715712 00000100:00100000:1.0:1788851056.571404:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716224 00000100:00100000:1.0:1788851056.571406:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716224 00000100:00100000:1.0:1788851056.571419:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716736 00000100:00100000:1.0:1788851056.571421:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716736 00000100:00100000:1.0:1788851056.571436:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788851056.571441:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019716608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571473:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019716608:12345-0@lo:400:kworker.0 Request processed in 31us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851056.571479:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788851056.571491:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788851056.571497:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019715712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571537:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019715712:12345-0@lo:400:kworker.0 Request processed in 40us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851056.571543:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788851056.571554:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788851056.571560:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019716224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571585:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019716224:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851056.571590:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788851056.571600:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788851056.571605:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019716736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571641:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019716736:12345-0@lo:400:kworker.0 Request processed in 36us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851056.571647:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788851056.571713:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019715712:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571723:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019716224:0@lo:400:kworker.0 00010000:00080000:1.0:1788851056.571734:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88150380 x1875746019716736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851056.571745:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019716736:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571754:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019715584:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571763:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019716096:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571772:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019716608:0@lo:400:kworker.0 00000100:00080000:1.0:1788851056.571821:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851056.571826:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851056.571858:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019715840:0@lo:400:kworker.0 00000100:00100000:3.0:1788851056.571875:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019715968:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.571890:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851056.571913:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019716352:0@lo:400:kworker.0 00000004:00080000:2.0:1788851056.572077:0:8618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390631063050ns, next at 391631059991ns, rc = 0 00000100:00100000:2.0:1788851056.572100:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715840 00000100:00100000:2.0:1788851056.572105:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715840 00000100:00100000:2.0:1788851056.572134:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788851056.572140:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019715840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.575884:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851056.575978:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019716864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851056.576044:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851056.576100:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716352 00000100:00100000:1.0:1788851056.576107:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716352 00000100:00100000:1.0:1788851056.576169:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788851056.576178:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019716352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.576250:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019716352:12345-0@lo:400:kworker.0 Request processed in 73us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851056.576258:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:1.0:1788851056.576283:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788851056.576315:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88150a80 x1875746019716352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851056.576330:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019716352:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.576390:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716864 00000100:00100000:1.0:1788851056.576394:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716864 00000100:00100000:1.0:1788851056.576427:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788851056.576433:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019716864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851056.576448:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851056.576483:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019716864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851056.576488:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788851056.576502:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788851056.576536:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c36d80 x1875746019716864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851056.576550:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019716864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851056.577777:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851056.578322:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019716480:0@lo:400:kworker.0 00000100:00100000:3.0:1788851056.578414:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851056.578501:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716480 00000100:00100000:3.0:1788851056.578512:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716480 00000100:00100000:3.0:1788851056.578582:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788851056.578596:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019716480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.581086:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715968 00000100:00100000:1.0:1788851056.581102:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715968 00000100:00100000:1.0:1788851056.581188:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788851056.581199:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019715968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.581321:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019715968:12345-0@lo:400:kworker.0 Request processed in 124us (3558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851056.581347:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788851056.582174:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019716480:12345-0@lo:400:kworker.0 Request processed in 3573us (3752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851056.582191:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788851056.583509:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019715968:0@lo:400:kworker.0 00010000:00080000:3.0:1788851056.583533:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88152680 x1875746019716480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851056.583546:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019716480:0@lo:400:kworker.0 00000100:00100000:2.0:1788851056.594622:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019715840:12345-0@lo:400:kworker.0 Request processed in 22469us (22721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851056.594642:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788851056.594838:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019715840:0@lo:400:kworker.0 00010000:00010000:2.0:1788851056.830962:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788851057.385245:0:13699:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1788851057.589832:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019716992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851057.589904:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851057.593864:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716992 00000100:00100000:1.0:1788851057.593880:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716992 00000100:00100000:1.0:1788851057.593951:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788851057.593964:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019716992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788851057.594007:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788851057.594116:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019716992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (4212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851057.594123:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788851057.594177:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019716992:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851057.847485:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851058.868885:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788851058.978604:0:13747:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbf0f1d70 20000000:00000080:2.0:1788851058.978642:0:13747:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892e92e8b000 uarg=0000000000000000 20000000:01000000:2.0:1788851058.978800:0:13747:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788851058.978808:0:13747:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788851058.978814:0:13747:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788851058.979737:0:13748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788851058.979911:0:13747:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788851058.987772:0:13747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788851058.987826:0:13747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788851058.987846:0:13747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788851058.987862:0:13747:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788851058.987884:0:13747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.987907:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389c5 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.987916:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389cc expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.987924:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a5c expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.987932:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a6a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.987956:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a78 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.987964:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205a86 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.987972:0:13747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.988785:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205a86 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.988802:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205a86 expref: 23 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851058.988818:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717120:0@lo:104: 00000100:00100000:0.0:1788851058.988908:0:13747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851058.989286:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205a78 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.989296:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205a78 expref: 23 pid: 6529 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851058.989305:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717248:0@lo:104: 00010000:00010000:0.0:1788851058.989330:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205a6a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.989338:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205a6a expref: 23 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851058.989360:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717376:0@lo:104: 00010000:00010000:0.0:1788851058.989385:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b205a5c expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.989392:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b205a5c expref: 23 pid: 6528 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851058.989399:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717504:0@lo:104: 00010000:00010000:0.0:1788851058.989423:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389cc expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.989433:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389cc expref: 12 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851058.989443:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717632:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851058.989506:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389c5 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851058.989514:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389c5 expref: 12 pid: 6529 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851058.989521:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717760:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851058.989539:0:13747:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788851058.995314:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717632:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851058.995332:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717760:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851058.998785:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851058.998894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851058.999339:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758912 00000100:00100000:2.0:1788851058.999350:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758912 00010000:00010000:2.0:1788851058.999399:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389cc expref: 13 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851058.999448:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759040 00000100:00100000:2.0:1788851058.999451:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759040 00010000:00010000:2.0:1788851058.999467:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389c5 expref: 14 pid: 6529 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851058.999496:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:2.0:1788851058.999506:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+14:2407:x1875746000758912:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851058.999521:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851058.999526:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389cc expref: 14 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851058.999538:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389cc expref: 14 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851058.999559:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031a00/0x3e0030720b205a55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389cc expref: 14 pid: 6528 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851058.999587:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851058.999666:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000758912:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 153us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851058.999674:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:2.0:1788851058.999693:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:2.0:1788851058.999699:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:2407:x1875746000759040:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851058.999706:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851058.999710:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389c5 expref: 12 pid: 6529 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851058.999730:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389c5 expref: 12 pid: 6529 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851058.999740:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6c00/0x3e0030720b205a4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c389c5 expref: 12 pid: 6529 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851058.999749:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851058.999880:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:2407:x1875746000759040:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 71us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851058.999888:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000004:00080000:3.0:1788851059.006438:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788851059.006504:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1788851059.006518:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788851059.006976:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019717888:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788851059.007113:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851059.007233:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007270:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007278:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007284:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851059.007289:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007297:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007318:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1fc305e7 (ffff892d87409f00) 00010000:00010000:0.0:1788851059.007322:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851059.007327:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007334:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b205b19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007351:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007357:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007363:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007367:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851059.007376:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007382:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007390:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff892d8797da00) 00010000:00010000:0.0:1788851059.007392:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851059.007394:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007400:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b205b2e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007420:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007426:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007432:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007437:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851059.007441:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007446:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007454:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1fc305e7 (ffff892d87409f00) 00010000:00010000:0.0:1788851059.007457:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851059.007466:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007473:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205b97 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1fc305e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007490:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007497:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007503:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007508:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851059.007511:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007516:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007524:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff892d8797d300) 00010000:00010000:0.0:1788851059.007526:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851059.007528:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.007534:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b205bb3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851059.007859:0:6518:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788851059.007891:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851059.007916:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851059.007927:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851059.007937:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717120 00000100:00100000:1.0:1788851059.007944:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717120 00000100:00100000:1.0:1788851059.007958:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717248 00000100:00100000:1.0:1788851059.007961:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717248 00000100:00100000:1.0:1788851059.007990:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717376 00000100:00100000:1.0:1788851059.007992:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717376 00000100:00100000:1.0:1788851059.008001:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717504 00000100:00100000:1.0:1788851059.008004:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717504 00000100:00100000:1.0:1788851059.008034:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851059.008043:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:13747:x1875746019717248:12345-0@lo:104: 00010000:00010000:1.0:1788851059.008057:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008139:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788851059.008145:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+6:13747:x1875746019717248:12345-0@lo:104: Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851059.008152:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851059.008170:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788851059.008176:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:13747:x1875746019717376:12345-0@lo:104: 00010000:00010000:1.0:1788851059.008183:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008216:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788851059.008221:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+5:13747:x1875746019717376:12345-0@lo:104: Request processed in 46us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851059.008226:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788851059.008237:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788851059.008243:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:13747:x1875746019717504:12345-0@lo:104: 00010000:00010000:1.0:1788851059.008249:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008274:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788851059.008279:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+4:13747:x1875746019717504:12345-0@lo:104: Request processed in 37us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851059.008284:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1788851059.008301:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788851059.008306:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008323:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433dc00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851059.008327:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008336:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851059.008342:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851059.008348:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851059.008380:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008386:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851059.008403:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008409:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433dc00/0x3e0030720b205a78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008420:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851059.008423:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008429:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851059.008432:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008449:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851059.008456:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851059.008461:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851059.008475:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008481:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851059.008494:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008500:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205a6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008509:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851059.008511:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008516:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030800 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851059.008518:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008525:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851059.008532:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851059.008541:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851059.008554:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008559:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851059.008579:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008586:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b205a5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a63 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.008597:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851059.008598:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851059.008600:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851059.008606:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851059.008617:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019718016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851059.009187:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717888 00000100:00100000:2.0:1788851059.009194:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717888 00000100:00100000:2.0:1788851059.009252:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788851059.009259:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019717888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788851059.009285:0:8625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788851059.009323:0:8625:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9fb36c, atime: 0x6a9fb36c, ctime: 0x6a9fb36c, blocks: 0x0 00010000:00010000:2.0:1788851059.009332:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851059.009349:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788851059.009353:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851059.009360:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851059.009380:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851059.009404:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851059.009412:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851059.009426:0:8625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788851059.009796:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851059.009838:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718016 00000100:00100000:0.0:1788851059.009843:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718016 00010000:00010000:0.0:1788851059.009866:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a78 expref: 24 pid: 6529 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851059.009898:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788851059.009906:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019718016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851059.009916:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851059.009921:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a78 expref: 24 pid: 6529 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.009930:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205a78 expref: 24 pid: 6529 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.009947:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788851059.009985:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851059.010497:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019718272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851059.014997:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019717888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5729us (7875us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788851059.015028:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788851059.015124:0:13747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80030c00/0x3e0030720b205a7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205a78 expref: 24 pid: 6529 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851059.015140:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717248:0@lo:104: 00000100:00100000:2.0:1788851059.015152:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717376:0@lo:104: 00000100:00100000:2.0:1788851059.015161:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717504:0@lo:104: 00000100:00100000:2.0:1788851059.016522:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019718144:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1788851059.018807:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892ea7c35880/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788851059.018826:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019717888:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788851059.019422:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851059.019434:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019449:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2154800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851059.019454:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019467:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019522:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019531:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e13cc51e/0x3e0030720b205bc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019578:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851059.019580:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851059.019581:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851059.019667:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788851059.019679:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea59b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:13747:x1875746019717120:12345-0@lo:104: 00010000:00010000:1.0:1788851059.019697:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019769:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788851059.019775:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea59b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+3:13747:x1875746019717120:12345-0@lo:104: Request processed in 100us (30868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851059.019782:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788851059.019824:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851059.019829:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019836:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7e00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851059.019841:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019849:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851059.019862:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851059.019869:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851059.019911:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019918:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851059.019940:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019947:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892d876e7e00/0x3e0030720b205a86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b205a8d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.019963:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851059.019965:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851059.019967:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851059.019974:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851059.019987:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019718400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851059.020072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851059.022994:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718400 00000100:00100000:0.0:1788851059.023009:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718400 00010000:00010000:0.0:1788851059.023095:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a86 expref: 24 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851059.023141:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788851059.023152:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019718400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851059.023171:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851059.023177:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a86 expref: 24 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.023195:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205a86 expref: 24 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851059.023220:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851059.023296:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019718400:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (3224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851059.023304:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788851059.023367:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3648:x1875746019718016:12345-0@lo:103:ldlm_bl.0 Request processed in 13463us (13571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851059.023374:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788851059.023593:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851059.024200:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718272 00000100:00100000:1.0:1788851059.024208:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718272 00010000:00010000:1.0:1788851059.024237:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a5c expref: 23 pid: 6528 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851059.024275:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788851059.024283:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3650:x1875746019718272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851059.024296:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851059.024313:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a5c expref: 23 pid: 6528 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.024323:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205a5c expref: 23 pid: 6528 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.024338:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433c200/0x3e0030720b205a63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205a5c expref: 23 pid: 6528 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.024351:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851059.024395:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:3650:x1875746019718272:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851059.024401:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788851059.024439:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019718400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851059.024451:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019718016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851059.024766:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019718272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851059.027506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851059.027645:0:13747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6200/0x3e0030720b205a8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205a86 expref: 21 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851059.027837:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718144 00000100:00100000:3.0:1788851059.027845:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718144 00010000:00010000:3.0:1788851059.027888:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a6a expref: 22 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851059.027923:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788851059.027931:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:3649:x1875746019718144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851059.027945:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851059.027963:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b205a6a expref: 22 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.027974:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b205a6a expref: 22 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.027992:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031e00/0x3e0030720b205a71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b205a6a expref: 22 pid: 6526 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028009:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028041:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028057:0:7476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028064:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028070:0:7476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028076:0:7476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028089:0:7476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851059.028093:0:7476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028101:0:7476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028116:0:7476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851059.028127:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851059.028195:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:3649:x1875746019718144:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851059.028202:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788851059.028272:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019718144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851059.028471:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875746019717120:0@lo:104: 00010000:00010000:2.0:1788851059.028515:0:13747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851059.028524:0:13747:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851059.028530:0:13747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851059.028536:0:13747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433d400/0x3e0030720b205bc1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851059.454665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851059.454753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851059.454775:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851059.454934:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759424 00000100:00100000:3.0:1788851059.454945:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759424 00000100:00100000:3.0:1788851059.455028:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:3.0:1788851059.455039:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000759424:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851059.455126:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000759424:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851059.455133:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00080000:3.0:1788851059.455155:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851059.477993:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851059.478600:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759168 00000100:00100000:1.0:1788851059.478618:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759168 00000100:00100000:1.0:1788851059.478720:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759680 00000100:00100000:1.0:1788851059.478724:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759680 00000100:00100000:1.0:1788851059.478754:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 219 00000100:00100000:1.0:1788851059.478770:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000759168:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851059.478870:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000759168:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 105us (24217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851059.478878:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 219 00000100:00100000:1.0:1788851059.478897:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 220 00000100:00100000:1.0:1788851059.478903:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000759680:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851059.478928:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000759680:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (24152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851059.478941:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 220 00000100:00080000:1.0:1788851059.479147:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851059.479152:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851059.485372:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851059.485512:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759296 00000100:00100000:2.0:1788851059.485523:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759296 00000100:00100000:2.0:1788851059.485589:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759552 00000100:00100000:2.0:1788851059.485593:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759552 00000100:00100000:2.0:1788851059.485614:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 221 00000100:00100000:2.0:1788851059.485635:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000759296:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851059.485718:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000759296:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 94us (7737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851059.485725:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 221 00000100:00100000:2.0:1788851059.485741:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 222 00000100:00100000:2.0:1788851059.485748:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000759552:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851059.485773:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000759552:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851059.485779:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 222 00000100:00080000:1.0:1788851059.493802:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851059.493813:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851059.639189:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851059.639216:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019718528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851059.639299:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851059.639364:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718528 00000100:00100000:0.0:1788851059.639372:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718528 00000100:00100000:0.0:1788851059.639418:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788851059.639428:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019718528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851059.639467:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788851059.639512:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019718528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851059.639520:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788851059.639567:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019718528:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788851059.892232:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788851059.927789:0:13796:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc6093640 20000000:00000080:0.0:1788851059.927805:0:13796:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892ea7c33000 uarg=0000000000000000 20000000:01000000:0.0:1788851059.927850:0:13796:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788851059.927857:0:13796:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788851059.927862:0:13796:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788851059.939129:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788851059.939320:0:13796:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788851059.939444:0:13796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788851059.939470:0:13796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788851059.939483:0:13796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788851059.939494:0:13796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788851059.939516:0:13796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939535:0:13796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939550:0:13796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939558:0:13796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939565:0:13796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939574:0:13796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939580:0:13796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851059.939585:0:13796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939608:0:13796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939633:0:13796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939649:0:13796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851059.939656:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94800/0x3e0030720b205bcf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851060.723272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851060.729840:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759808 00000100:00100000:2.0:1788851060.729865:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759808 00000100:00100000:1.0:1788851060.730159:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 341 00000100:00100000:1.0:1788851060.730175:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:6192:x1875746000759808:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851060.730195:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851060.730220:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94800/0x3e0030720b205bd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a19 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.730253:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94800/0x3e0030720b205bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a19 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.730265:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94800/0x3e0030720b205bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a19 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.730274:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94800, rc 0) 00000100:00100000:1.0:1788851060.730606:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000759808:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 426us (7335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.730625:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 341 00000100:00100000:3.0:1788851060.733587:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851060.733675:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759936 00000100:00100000:1.0:1788851060.733685:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759936 00000100:00100000:1.0:1788851060.733739:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 342 00000100:00100000:1.0:1788851060.733749:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000759936:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.734396:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000759936:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 644us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.734405:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 342 00000100:00100000:3.0:1788851060.737273:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851060.737429:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760064 00000100:00100000:1.0:1788851060.737442:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760064 00000100:00100000:1.0:1788851060.737503:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 343 00000100:00100000:1.0:1788851060.737513:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000760064:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.738177:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000760064:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 663us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.738187:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 343 00000100:00100000:0.0:1788851060.748675:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851060.748795:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760192 00000100:00100000:1.0:1788851060.748806:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760192 00000100:00100000:1.0:1788851060.748868:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 344 00000100:00100000:1.0:1788851060.748878:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:10823:x1875746000760192:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851060.749086:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:10823:x1875746000760192:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 209us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.749094:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 344 00000100:00100000:2.0:1788851060.759893:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851060.760200:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760320 00000100:00100000:1.0:1788851060.760212:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760320 00000100:00100000:1.0:1788851060.760288:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00100000:1.0:1788851060.760298:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:10823:x1875746000760320:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851060.760452:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:10823:x1875746000760320:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 156us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.760460:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00100000:3.0:1788851060.765290:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851060.765456:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760448 00000100:00100000:2.0:1788851060.765467:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760448 00000100:00100000:2.0:1788851060.765526:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 346 00000100:00100000:2.0:1788851060.765536:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:6192:x1875746000760448:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851060.765555:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851060.765576:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2155a00/0x3e0030720b205bdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a20 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851060.765616:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2155a00/0x3e0030720b205bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a20 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851060.765638:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2155a00/0x3e0030720b205bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a20 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851060.765661:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2155a00, rc 0) 00000100:00100000:2.0:1788851060.765730:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000760448:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 195us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851060.765737:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 346 00000100:00100000:0.0:1788851060.775895:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851060.776219:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760576 00000100:00100000:3.0:1788851060.776230:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760576 00000100:00100000:3.0:1788851060.776292:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 347 00000100:00100000:3.0:1788851060.776303:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000760576:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851060.776475:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000760576:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 172us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851060.776483:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 347 00000100:00100000:3.0:1788851060.778475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851060.778863:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760704 00000100:00100000:1.0:1788851060.778875:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760704 00000100:00100000:1.0:1788851060.778942:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 348 00000100:00100000:1.0:1788851060.778952:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000760704:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.779135:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:6192:x1875746000760704:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 184us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.779143:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 348 00000100:00100000:0.0:1788851060.781979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851060.782840:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760832 00000100:00100000:1.0:1788851060.782853:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760832 00000100:00100000:1.0:1788851060.782967:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 349 00000100:00100000:1.0:1788851060.782978:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:10826:x1875746000760832:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851060.783170:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:10826:x1875746000760832:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 194us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.783180:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 349 00000100:00100000:0.0:1788851060.792456:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851060.792559:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760960 00000100:00100000:3.0:1788851060.792571:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760960 00000100:00100000:3.0:1788851060.792643:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 350 00000100:00100000:3.0:1788851060.792663:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:10826:x1875746000760960:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788851060.792827:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:10826:x1875746000760960:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 166us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851060.792835:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 350 10000000:01000000:0.0:1788851060.852237:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851060.852246:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea7c1e800 from 7 10000000:01000000:0.0:1788851060.852251:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851060.852308:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.852321:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.852334:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851060.853220:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019718656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.857872:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.857963:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851060.858229:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718656 00000100:00100000:3.0:1788851060.858238:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718656 00000100:00100000:3.0:1788851060.858291:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788851060.858301:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:6531:x1875746019718656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851060.858318:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851060.858337:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031e00/0x3e0030720b205beb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205be4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851060.858371:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031e00/0x3e0030720b205beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205be4 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851060.858384:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031e00/0x3e0030720b205beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205be4 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851060.858394:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031e00, rc 0) 00000100:00100000:3.0:1788851060.858452:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019718656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851060.858460:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788851060.860270:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019718656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851060.860300:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.860312:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851060.860415:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019718784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.860475:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.860946:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851060.861102:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718784 00000100:00100000:2.0:1788851060.861110:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718784 00000100:00100000:2.0:1788851060.861160:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788851060.861169:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019718784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851060.861302:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019718784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851060.861309:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788851060.861541:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019718784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.861576:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019718912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.861639:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.861674:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851060.861980:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718912 00000100:00100000:2.0:1788851060.861984:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718912 00000100:00100000:2.0:1788851060.862060:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788851060.862067:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019718912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851060.862146:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019718912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851060.862153:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788851060.862905:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019718912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851060.863447:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13809:1875746019719040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851060.863502:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851060.863559:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d8685a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851060.864215:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019719040 00000100:00100000:2.0:1788851060.864224:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019719040 00000100:00100000:2.0:1788851060.864274:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788851060.864283:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:13809:x1875746019719040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851060.864436:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:13809:x1875746019719040:12345-0@lo:502:llog_process_th.0 Request processed in 154us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851060.864444:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788851060.865198:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13809:1875746019719040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788851060.865233:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851060.865243:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851060.865245:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851060.865253:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892ea7c1e800 00000020:00000080:1.0:1788851060.865256:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851060.865337:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851060.865340:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851060.865342:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851060.865345:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851060.865348:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851060.865349:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788851060.865353:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892ea7c1e800 00000020:00000080:1.0:1788851060.865355:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788851060.865404:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13809:1875746019719168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851060.865458:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851060.865497:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851060.866244:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019719168 00000100:00100000:2.0:1788851060.866254:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019719168 00000100:00100000:2.0:1788851060.869628:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788851060.869666:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:13809:x1875746019719168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851060.869859:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:13809:x1875746019719168:12345-0@lo:502:llog_process_th.0 Request processed in 213us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851060.869867:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788851060.874588:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13809:1875746019719168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788851060.874871:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851060.874881:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851060.874884:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788851060.874889:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788851060.875350:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788851060.875375:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788851060.875389:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.875402:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851060.875414:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851060.875417:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea5900800 from 7 10000000:01000000:0.0:1788851060.875420:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851060.875460:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.875469:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.875478:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851060.875505:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019719296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.875583:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.875835:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788851060.875896:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019719296 00000100:00100000:1.0:1788851060.875904:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019719296 00000100:00100000:1.0:1788851060.875964:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788851060.875974:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:6531:x1875746019719296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851060.875989:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851060.876004:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff95800/0x3e0030720b205bf9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205bf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.876246:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff95800/0x3e0030720b205bf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205bf2 expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.876257:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff95800/0x3e0030720b205bf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205bf2 expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.876276:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95800, rc 0) 00000100:00100000:1.0:1788851060.876330:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019719296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 357us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.876337:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788851060.876415:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019719296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851060.876430:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.876439:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851060.876498:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019719424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.876535:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.876592:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851060.878781:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019719424 00000100:00100000:2.0:1788851060.878796:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019719424 00000100:00100000:2.0:1788851060.878901:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788851060.878912:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019719424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851060.880369:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019719424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1452us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851060.880384:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788851060.880540:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019719424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.880609:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019719552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.880675:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851060.886835:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87bee900 going to sleep for 11 seconds 00000100:00100000:0.0:1788851060.888135:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019719552 00000100:00100000:0.0:1788851060.888154:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019719552 00000100:00100000:0.0:1788851060.888218:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788851060.888230:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019719552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.888459:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019719552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (7783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851060.888467:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788851060.888900:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019719552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851060.889793:0:13812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13812:1875746019719680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851060.889857:0:13812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851060.893531:0:13812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87a41840 going to sleep for 11 seconds 00000100:00100000:0.0:1788851060.894936:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019719680 00000100:00100000:0.0:1788851060.894949:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019719680 00000100:00100000:0.0:1788851060.895030:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788851060.895041:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:13812:x1875746019719680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851060.895218:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:13812:x1875746019719680:12345-0@lo:502:llog_process_th.0 Request processed in 180us (5360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851060.895227:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788851060.895454:0:13812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13812:1875746019719680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788851060.895493:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851060.895503:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851060.895506:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788851060.895517:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892ea5900800 00000020:00000080:3.0:1788851060.895520:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788851060.895611:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851060.895934:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851060.895936:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788851060.895941:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851060.895944:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851060.895945:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788851060.895949:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892ea5900800 00000020:00000080:3.0:1788851060.895951:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788851060.896246:0:13812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13812:1875746019719808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851060.896319:0:13812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851060.896360:0:13812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e98353780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851060.896974:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019719808 00000100:00100000:2.0:1788851060.896984:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019719808 00000100:00100000:2.0:1788851060.897072:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788851060.897081:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:13812:x1875746019719808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851060.897208:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:13812:x1875746019719808:12345-0@lo:502:llog_process_th.0 Request processed in 128us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851060.897215:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788851060.897272:0:13812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13812:1875746019719808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851060.897299:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851060.897305:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851060.897307:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788851060.897311:0:13812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788851060.897958:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788851060.897982:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788851060.897994:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.898007:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851060.898059:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851060.898062:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ebbbf6000 from 7 10000000:01000000:0.0:1788851060.898065:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851060.898099:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.898108:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.898117:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851060.898137:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019719936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.898187:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.898224:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851060.898246:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019719936 00000100:00100000:0.0:1788851060.898252:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019719936 00000100:00100000:0.0:1788851060.898286:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788851060.898294:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:6531:x1875746019719936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851060.898306:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851060.898323:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433dc00/0x3e0030720b205c07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205c00 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.898371:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433dc00/0x3e0030720b205c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205c00 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.898384:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433dc00/0x3e0030720b205c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205c00 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.898394:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433dc00, rc 0) 00000100:00100000:0.0:1788851060.898434:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019719936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851060.898441:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788851060.898477:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019719936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851060.898488:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.898497:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851060.898559:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.898582:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.898604:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851060.898616:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019720064 00000100:00100000:0.0:1788851060.898814:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019720064 00000100:00100000:0.0:1788851060.898837:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788851060.898844:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019720064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.898947:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019720064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851060.898964:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788851060.898995:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.899064:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.899103:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.899117:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851060.899129:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019720192 00000100:00100000:0.0:1788851060.899132:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019720192 00000100:00100000:0.0:1788851060.899149:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788851060.899154:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019720192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.899224:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019720192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851060.899231:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788851060.899269:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.899471:0:13814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13814:1875746019720320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851060.899506:0:13814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.899523:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019720320 00000100:00100000:0.0:1788851060.899540:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019720320 00000100:00100000:0.0:1788851060.899558:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788851060.899564:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:13814:x1875746019720320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851060.900291:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:13814:x1875746019720320:12345-0@lo:502:llog_process_th.0 Request processed in 725us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851060.900301:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788851060.900338:0:13814:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab000 going to sleep for 11 seconds 00000100:00100000:0.0:1788851060.900352:0:13814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13814:1875746019720320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788851060.900382:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851060.900394:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851060.900396:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788851060.900403:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892ebbbf6000 00000020:00000080:0.0:1788851060.900406:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788851060.900468:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851060.901397:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851060.901403:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788851060.901411:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851060.901415:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851060.901417:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788851060.901422:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892ebbbf6000 00000020:00000080:0.0:1788851060.901424:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788851060.901515:0:13814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13814:1875746019720448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851060.902401:0:13814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.902516:0:13814:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab000 going to sleep for 11 seconds 00000040:00080000:0.0:1788851060.903461:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851060.907741:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019720448 00000100:00100000:3.0:1788851060.907760:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019720448 00000100:00100000:3.0:1788851060.907873:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788851060.907887:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:13814:x1875746019720448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851060.908132:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:13814:x1875746019720448:12345-0@lo:502:llog_process_th.0 Request processed in 249us (5734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851060.908142:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788851060.908209:0:13814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13814:1875746019720448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788851060.908245:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851060.908253:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851060.908262:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788851060.908271:0:13814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788851060.912221:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788851060.912265:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788851060.912278:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.912293:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851060.912307:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851060.912311:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e91596800 from 7 10000000:01000000:0.0:1788851060.912314:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851060.912366:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.912387:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851060.912400:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851060.912433:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851060.912518:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.912580:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851060.912944:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019720576 00000100:00100000:1.0:1788851060.912966:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019720576 00000100:00100000:1.0:1788851060.913049:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788851060.913059:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:6531:x1875746019720576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851060.913075:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851060.913089:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94600/0x3e0030720b205c15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b205c0e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.913112:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94600/0x3e0030720b205c15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b205c0e expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.913122:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94600/0x3e0030720b205c15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b205c0e expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.913130:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94600, rc 0) 00000100:00100000:1.0:1788851060.913184:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019720576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.913190:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788851060.913251:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851060.913267:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.913278:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851060.913351:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.913380:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851060.913395:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851060.913408:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019720704 00000100:00100000:1.0:1788851060.913411:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019720704 00000100:00100000:1.0:1788851060.913425:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788851060.913431:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019720704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.913558:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019720704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.913565:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788851060.913591:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.913708:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.913747:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851060.913761:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851060.913771:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019720832 00000100:00100000:1.0:1788851060.913775:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019720832 00000100:00100000:1.0:1788851060.913790:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788851060.913795:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019720832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.913873:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:6531:x1875746019720832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.913884:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788851060.913919:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c5226fe-29cd-49fb-9546-e50c12b232cb:6531:1875746019720832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851060.914112:0:13816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13816:1875746019720960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851060.914142:0:13816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851060.914157:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019720960 00000100:00100000:1.0:1788851060.914161:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019720960 00000100:00100000:1.0:1788851060.914177:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788851060.914184:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:13816:x1875746019720960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851060.914246:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:13816:x1875746019720960:12345-0@lo:502:llog_process_th.0 Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.914253:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788851060.914285:0:13816:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87bee900 going to sleep for 11 seconds 00000100:00100000:1.0:1788851060.914296:0:13816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13816:1875746019720960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788851060.914318:0:13816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851060.914328:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851060.914331:0:13816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851060.914339:0:13816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892e91596800 00000020:00000080:1.0:1788851060.914341:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851060.914409:0:13816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851060.914413:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851060.914414:0:13816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851060.914417:0:13816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851060.914419:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851060.914420:0:13816:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788851060.914424:0:13816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892e91596800 00000020:00000080:1.0:1788851060.914426:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788851060.914462:0:13816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13816:1875746019721088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851060.914491:0:13816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851060.914506:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019721088 00000100:00100000:1.0:1788851060.914509:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019721088 00000100:00100000:1.0:1788851060.914525:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788851060.914530:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:13816:x1875746019721088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851060.914579:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:13816:x1875746019721088:12345-0@lo:502:llog_process_th.0 Request processed in 48us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851060.914585:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788851060.914945:0:13816:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851060.915008:0:13816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c5226fe-29cd-49fb-9546-e50c12b232cb:13816:1875746019721088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788851060.915050:0:13816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851060.915055:0:13816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851060.915057:0:13816:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788851060.915061:0:13816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788851060.915118:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788851060.915136:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851060.915146:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.915156:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851060.917144:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851060.928352:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851061.684378:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019721344:0@lo:400:kworker.0 00000100:00100000:1.0:1788851061.684401:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019721472:0@lo:400:kworker.0 00000100:00100000:0.0:1788851061.684663:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019721216:0@lo:400:kworker.0 00000100:00100000:3.0:1788851061.684864:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851061.684944:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019721856:0@lo:400:kworker.0 00000100:00100000:3.0:1788851061.684971:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851061.685007:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019722368:0@lo:400:kworker.0 00000100:00100000:3.0:1788851061.685051:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851061.685069:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019722880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851061.685094:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851061.685155:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019721344 00000100:00100000:3.0:1788851061.685164:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019721344 00000100:00100000:3.0:1788851061.685213:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019721856 00000100:00100000:3.0:1788851061.685217:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019721856 00000100:00100000:3.0:1788851061.685245:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019722368 00000100:00100000:3.0:1788851061.685248:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019722368 00000100:00100000:3.0:1788851061.685267:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788851061.685275:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019721344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851061.685332:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019721344:12345-0@lo:400:kworker.0 Request processed in 58us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851061.685339:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788851061.685357:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788851061.685364:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019721856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851061.685391:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019721856:12345-0@lo:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851061.685397:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788851061.685409:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788851061.685433:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019722368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.685870:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019722880 00000100:00100000:2.0:1788851061.685876:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019722880 00000100:00100000:2.0:1788851061.685924:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788851061.685932:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019722880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851061.685956:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851061.689988:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019722880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4046us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851061.690002:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788851061.690101:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019721600:0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.690146:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851061.690190:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019722112:0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.690235:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851061.690262:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019722624:0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.690285:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851061.690306:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019723136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851061.690331:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851061.690354:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851061.690361:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019723008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851061.690380:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851061.690407:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019722112 00000100:00100000:2.0:1788851061.690415:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019722112 00000100:00100000:2.0:1788851061.690472:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019722624 00000100:00100000:2.0:1788851061.690476:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019722624 00000100:00100000:2.0:1788851061.690501:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788851061.690509:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019722112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.690562:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019722112:12345-0@lo:400:kworker.0 Request processed in 54us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851061.690569:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788851061.690593:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788851061.690601:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019722624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.690628:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019722624:12345-0@lo:400:kworker.0 Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851061.690634:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788851061.690651:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019723136 00000100:00100000:2.0:1788851061.690654:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019723136 00000100:00100000:2.0:1788851061.690686:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019723008 00000100:00100000:2.0:1788851061.690690:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019723008 00000100:00100000:2.0:1788851061.690703:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788851061.690716:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019723136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851061.691662:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851061.691731:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019723136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1015us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851061.691844:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788851061.691866:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788851061.691875:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019723008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788851061.691900:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851061.691930:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019723008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851061.691936:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788851061.691959:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019721600 00000100:00100000:2.0:1788851061.691965:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019721600 00000100:00100000:2.0:1788851061.691997:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788851061.692004:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019721600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.692053:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019721600:12345-0@lo:400:kworker.0 Request processed in 50us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851061.692060:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788851061.692115:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019723008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851061.692129:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019721600:0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.692137:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019722112:0@lo:400:kworker.0 00010000:00080000:2.0:1788851061.692150:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9a300 x1875746019722624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851061.692160:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019722624:0@lo:400:kworker.0 00010000:00080000:2.0:1788851061.692183:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c37b80 x1875746019723136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851061.692195:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019723136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851061.692270:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019722880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851061.692285:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019721344:0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.692299:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019721856:0@lo:400:kworker.0 00000100:00080000:2.0:1788851061.692353:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788851061.692358:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851061.692361:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851061.695097:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019722368:12345-0@lo:400:kworker.0 Request processed in 9654us (10033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851061.695097:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851061.695115:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788851061.695155:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019721728:0@lo:400:kworker.0 00000100:00100000:3.0:1788851061.695191:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019722368:0@lo:400:kworker.0 00000100:00100000:3.0:1788851061.695236:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019721216 00000100:00100000:3.0:1788851061.695242:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019721216 00000100:00100000:3.0:1788851061.695287:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788851061.695295:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019721216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851061.695484:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851061.695507:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019721728 00000100:00100000:0.0:1788851061.695511:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019721728 00000100:00100000:0.0:1788851061.695535:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788851061.695541:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019721728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851061.695572:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019721728:12345-0@lo:400:kworker.0 Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851061.695589:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788851061.695616:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019721728:0@lo:400:kworker.0 00000100:00100000:0.0:1788851061.695624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019722240:0@lo:400:kworker.0 00000100:00100000:0.0:1788851061.695645:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851061.695972:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851061.696008:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019721472 00000100:00100000:1.0:1788851061.696033:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019721472 00000100:00100000:1.0:1788851061.696076:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788851061.696084:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019721472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.696101:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019722240 00000100:00100000:2.0:1788851061.696107:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019722240 00000100:00100000:1.0:1788851061.696125:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019721472:12345-0@lo:400:kworker.0 Request processed in 43us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851061.696132:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788851061.696147:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788851061.696158:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019722240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851061.696167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019721472:0@lo:400:kworker.0 00000100:00100000:1.0:1788851061.696177:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019721984:0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.696202:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019722240:12345-0@lo:400:kworker.0 Request processed in 47us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851061.696213:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788851061.696214:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851061.696245:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019721984 00000100:00100000:1.0:1788851061.696249:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019721984 00000100:00080000:2.0:1788851061.696272:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851061.696284:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788851061.696292:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019721984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851061.696319:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019721984:12345-0@lo:400:kworker.0 Request processed in 29us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851061.696324:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00080000:1.0:1788851061.696347:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea591d180 x1875746019721984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851061.696357:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019721984:0@lo:400:kworker.0 00000100:00100000:1.0:1788851061.696363:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019722496:0@lo:400:kworker.0 00000100:00100000:0.0:1788851061.696613:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019722240:0@lo:400:kworker.0 00000100:00100000:0.0:1788851061.696630:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019722752:0@lo:400:kworker.0 00000100:00100000:0.0:1788851061.696654:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851061.696847:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851061.696869:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019722496 00000100:00100000:1.0:1788851061.696873:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019722496 00000100:00100000:1.0:1788851061.696903:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788851061.696909:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019722496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851061.696936:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019722496:12345-0@lo:400:kworker.0 Request processed in 28us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851061.696949:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:1.0:1788851061.696965:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788851061.696978:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9b480 x1875746019722496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851061.696988:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019722496:0@lo:400:kworker.0 00000100:00100000:0.0:1788851061.697092:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851061.697120:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851061.697201:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019723264 00000100:00100000:1.0:1788851061.697205:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019723264 00000100:00100000:1.0:1788851061.697245:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788851061.697252:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019723264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851061.697266:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851061.697297:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019723264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851061.697302:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788851061.697476:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788851061.697496:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c34700 x1875746019723264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851061.697510:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851061.697566:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019722752 00000100:00100000:2.0:1788851061.697571:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019722752 00000100:00100000:2.0:1788851061.697615:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788851061.697616:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019721216:12345-0@lo:400:kworker.0 Request processed in 2318us (2520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851061.697624:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019722752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851061.697631:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788851061.697857:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019721216:0@lo:400:kworker.0 00010000:00080000:0.0:1788851061.697868:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d86a9bb80 x1875746019722752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851061.697876:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019722752:0@lo:400:kworker.0 00000100:00100000:2.0:1788851061.697947:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019722752:12345-0@lo:400:kworker.0 Request processed in 324us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851061.697954:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1788851061.943368:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851061.943976:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788851061.944548:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788851062.708701:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019723392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851062.708774:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851062.709044:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019723392 00000100:00100000:1.0:1788851062.709053:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019723392 00000100:00100000:1.0:1788851062.709116:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788851062.709127:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019723392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788851062.709165:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788851062.709233:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019723392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851062.709240:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788851062.709433:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019723392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788851062.964887:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851063.988252:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851064.564599:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851064.564763:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851064.564871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851064.564934:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761088 00000100:00100000:2.0:1788851064.564945:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761088 00000100:00100000:2.0:1788851064.565051:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 372 00000100:00100000:2.0:1788851064.565063:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2408:x1875746000761088:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851064.565130:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2408:x1875746000761088:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 69us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851064.565137:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 372 00000100:00100000:3.0:1788851064.580506:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851064.590132:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761344 00000100:00100000:1.0:1788851064.590152:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761344 00000100:00080000:0.0:1788851064.590260:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851064.590261:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761600 00000100:00100000:1.0:1788851064.590279:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761600 00000100:00100000:0.0:1788851064.590310:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 229 00000100:00100000:0.0:1788851064.590326:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000761344:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851064.590418:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000761344:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 98us (25654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851064.592219:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 230 00000100:00100000:1.0:1788851064.592241:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000761600:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851064.592307:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000761600:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 78us (27437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851064.592315:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 230 00000100:00080000:1.0:1788851064.592351:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851064.595236:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 229 00000100:00100000:1.0:1788851064.595543:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761216 00000100:00100000:1.0:1788851064.595561:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761216 00000100:00100000:1.0:1788851064.595643:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 231 00000100:00100000:1.0:1788851064.595654:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000761216:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851064.595728:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000761216:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 77us (15232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851064.595736:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 231 00000100:00100000:1.0:1788851064.595794:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00080000:3.0:1788851064.596030:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851064.607058:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761472 00000100:00100000:3.0:1788851064.607078:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761472 00000100:00100000:3.0:1788851064.607223:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851064.607346:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761728 00000100:00100000:1.0:1788851064.607351:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761728 00000100:00100000:1.0:1788851064.607430:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 232 00000100:00100000:1.0:1788851064.607440:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000761728:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851064.608098:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000761728:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 656us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851064.608107:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 232 00000100:00100000:0.0:1788851064.608262:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:0.0:1788851064.608271:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000761472:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:3.0:1788851064.611371:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851064.611392:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851064.617047:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000761472:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 8767us (21242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851064.617076:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:1.0:1788851064.756575:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019723520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851064.756758:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851064.756925:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019723520 00000100:00100000:0.0:1788851064.756934:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019723520 00000100:00100000:0.0:1788851064.756987:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788851064.756996:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019723520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851064.757048:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788851064.757104:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019723520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851064.757111:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788851064.757283:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019723520:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788851064.759708:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1788851065.012180:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851066.037112:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851066.804212:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019723648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851066.804282:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851066.804303:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019723776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851066.804342:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851066.804385:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019723648 00000100:00100000:3.0:1788851066.804390:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851066.804393:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019723648 00000100:00100000:3.0:1788851066.804413:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019723904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851066.804442:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851066.804455:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019723776 00000100:00100000:0.0:1788851066.804460:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019723776 00000100:00100000:0.0:1788851066.804477:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019723904 00000100:00100000:0.0:1788851066.804489:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019723904 00000100:00080000:2.0:1788851066.804510:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851066.804516:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1788851066.804517:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851066.804527:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019723648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851066.804554:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851066.804604:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019723648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851066.804611:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788851066.804626:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788851066.804632:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019723776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788851066.804654:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851066.804693:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019723776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851066.804700:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788851066.804715:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788851066.804722:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019723904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851066.804731:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788851066.804739:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7d3fb80 x1875746019723776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851066.804755:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019723904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.804761:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019723776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851066.804775:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1788851066.804787:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c37b80 x1875746019723904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851066.804799:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019723904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851066.805963:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019724416:0@lo:400:kworker.0 00000100:00100000:3.0:1788851066.806008:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851066.806062:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019724928:0@lo:400:kworker.0 00000100:00100000:3.0:1788851066.806084:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851066.806101:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788851066.806105:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019724288:0@lo:400:kworker.0 00000100:00100000:3.0:1788851066.806121:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851066.806131:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019724800:0@lo:400:kworker.0 00000100:00100000:3.0:1788851066.806146:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851066.806156:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019725312:0@lo:400:kworker.0 00000100:00100000:3.0:1788851066.806188:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851066.806745:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019724928 00000100:00100000:2.0:1788851066.806753:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019724928 00000100:00100000:2.0:1788851066.806805:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019724288 00000100:00100000:2.0:1788851066.806808:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019724288 00000100:00100000:2.0:1788851066.806819:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019724800 00000100:00100000:2.0:1788851066.806821:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019724800 00000100:00100000:2.0:1788851066.806830:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019725312 00000100:00100000:2.0:1788851066.806832:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019725312 00000100:00100000:2.0:1788851066.806847:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788851066.806854:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019724928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851066.806904:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019724928:12345-0@lo:400:kworker.0 Request processed in 50us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851066.806910:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788851066.806925:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788851066.806930:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019724288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851066.806963:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019724416 00000100:00100000:2.0:1788851066.806971:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019724288:12345-0@lo:400:kworker.0 Request processed in 41us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851066.806978:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019724416 00000100:00100000:2.0:1788851066.806982:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788851066.806999:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788851066.807007:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019724800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851066.807037:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788851066.807046:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019724416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851066.807060:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019724800:12345-0@lo:400:kworker.0 Request processed in 53us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851066.807067:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788851066.807100:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019724416:12345-0@lo:400:kworker.0 Request processed in 56us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851066.807107:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788851066.807129:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788851066.807137:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019725312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851066.807166:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019725312:12345-0@lo:400:kworker.0 Request processed in 30us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851066.807172:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788851066.807216:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019724160:0@lo:400:kworker.0 00000100:00100000:1.0:1788851066.807249:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851066.807307:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019724160 00000100:00100000:3.0:1788851066.807312:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019724160 00000100:00080000:2.0:1788851066.807358:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851066.807360:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019724672:0@lo:400:kworker.0 00000100:00080000:2.0:1788851066.807364:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851066.807402:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019724288:0@lo:400:kworker.0 00000100:00100000:0.0:1788851066.807451:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019724032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851066.808586:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788851066.808602:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019724160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851066.812628:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019724800:0@lo:400:kworker.0 00010000:00080000:2.0:1788851066.812655:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7d3d880 x1875746019725312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851066.813161:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851066.813219:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019725184:0@lo:400:kworker.0 00000100:00100000:2.0:1788851066.813392:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019725312:0@lo:400:kworker.0 00000100:00100000:1.0:1788851066.813753:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851066.813856:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019724416:0@lo:400:kworker.0 00010000:00080000:2.0:1788851066.813871:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7d3ce00 x1875746019724928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851066.813881:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019724928:0@lo:400:kworker.0 00000100:00100000:3.0:1788851066.814290:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019724160:12345-0@lo:400:kworker.0 Request processed in 5693us (7037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.814309:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788851066.814405:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019725184 00000100:00100000:3.0:1788851066.814412:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019725184 00000100:00100000:3.0:1788851066.814470:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788851066.814479:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019725184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851066.814611:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019725184:12345-0@lo:400:kworker.0 Request processed in 134us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.814618:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:3.0:1788851066.814730:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851066.814753:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019724672 00000100:00100000:3.0:1788851066.814758:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019724672 00000100:00100000:3.0:1788851066.814786:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788851066.814793:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019724672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851066.814830:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019724672:12345-0@lo:400:kworker.0 Request processed in 37us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.814842:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788851066.814965:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788851066.814971:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892ea7c35880, transno 4294967301 00000100:00100000:1.0:1788851066.814996:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019723648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851066.815050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019724160:0@lo:400:kworker.0 00000100:00100000:0.0:1788851066.815149:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851066.815176:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019724544:0@lo:400:kworker.0 00000100:00100000:0.0:1788851066.815207:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851066.815226:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019725056:0@lo:400:kworker.0 00000100:00100000:0.0:1788851066.815246:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851066.815276:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019724544 00000100:00100000:0.0:1788851066.815280:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019724544 00000100:00100000:2.0:1788851066.816036:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019725056 00000100:00100000:2.0:1788851066.816044:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019725056 00000100:00100000:1.0:1788851066.816183:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019724672:0@lo:400:kworker.0 00000100:00100000:1.0:1788851066.816194:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019725184:0@lo:400:kworker.0 00000100:00100000:0.0:1788851066.816574:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788851066.816588:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019724544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851066.816658:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019724544:12345-0@lo:400:kworker.0 Request processed in 75us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851066.816665:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788851066.816700:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019724544:0@lo:400:kworker.0 00000100:00100000:3.0:1788851066.817216:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019724032 00000100:00100000:3.0:1788851066.817222:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019724032 00000100:00100000:2.0:1788851066.817338:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788851066.820215:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788851066.820304:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875746019724032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788851066.820338:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851066.820439:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875746019724032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 213us (5290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.820447:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788851066.820677:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851066.820750:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019724032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851066.822643:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019725056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851066.822959:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019725056:12345-0@lo:400:kworker.0 Request processed in 5613us (7710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851066.822970:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788851066.826251:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019725056:0@lo:400:kworker.0 00010000:00010000:1.0:1788851067.062520:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851067.829748:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019725440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851067.829828:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851067.829986:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019725440 00000100:00100000:0.0:1788851067.829995:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019725440 00000100:00100000:0.0:1788851067.830072:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788851067.830083:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019725440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788851067.830117:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788851067.830177:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019725440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851067.830184:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788851067.830288:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019725440:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851068.084369:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851069.108800:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851069.684376:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851069.684421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851069.684535:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851069.684587:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761856 00000100:00100000:0.0:1788851069.684598:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761856 00000100:00100000:0.0:1788851069.684654:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 374 00000100:00100000:0.0:1788851069.684663:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000761856:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851069.684735:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000761856:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 73us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851069.684743:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 374 00000100:00100000:3.0:1788851069.689506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851069.689532:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851069.689642:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762240 00000100:00100000:0.0:1788851069.689653:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762240 00000100:00100000:0.0:1788851069.689722:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:0.0:1788851069.689733:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000762240:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851069.689806:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000762240:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851069.689815:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00080000:0.0:1788851069.689851:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851069.692782:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761984 00000100:00100000:1.0:1788851069.692799:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761984 00000100:00080000:0.0:1788851069.693441:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851069.693505:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762112 00000100:00100000:1.0:1788851069.693511:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762112 00000100:00100000:1.0:1788851069.693547:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 239 00000100:00100000:1.0:1788851069.693560:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000761984:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851069.693642:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000761984:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 87us (9220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851069.693649:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 239 00000100:00100000:1.0:1788851069.693667:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 240 00000100:00100000:1.0:1788851069.693674:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000762112:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851069.693699:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000762112:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (9163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851069.693705:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 240 00000100:00080000:0.0:1788851069.694284:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851069.695786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851069.696969:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762496 00000100:00100000:2.0:1788851069.696983:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762496 00000100:00100000:2.0:1788851069.697070:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762368 00000100:00100000:2.0:1788851069.697074:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762368 00000100:00100000:2.0:1788851069.697115:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00100000:2.0:1788851069.697125:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000762496:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851069.697200:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000762496:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 76us (7666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851069.697208:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00100000:2.0:1788851069.697225:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00100000:2.0:1788851069.697232:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000762368:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851069.697253:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000762368:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851069.697258:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00080000:3.0:1788851069.697685:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851069.697689:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851069.876718:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851069.876752:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019725568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851069.876828:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851069.877134:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019725568 00000100:00100000:3.0:1788851069.877142:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019725568 00000100:00100000:3.0:1788851069.877196:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788851069.877205:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019725568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851069.877239:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788851069.877296:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019725568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851069.877303:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788851069.877549:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019725568:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788851070.132340:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851071.156717:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788851071.158470:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788851071.158719:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851071.924438:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019725824:0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.924508:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851071.924575:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019726336:0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.924599:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851071.924620:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019726848:0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.924641:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851071.924664:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788851071.924670:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019725952:0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.924696:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851071.924715:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019726464:0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.924736:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851071.924753:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019726976:0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.924786:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851071.924818:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019725952 00000100:00100000:3.0:1788851071.924825:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019725952 00000100:00100000:3.0:1788851071.924884:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788851071.924894:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019725952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.924950:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019725952:12345-0@lo:400:kworker.0 Request processed in 58us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.924958:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788851071.924981:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019725824 00000100:00100000:3.0:1788851071.924985:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019725824 00000100:00100000:3.0:1788851071.925003:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019726336 00000100:00100000:3.0:1788851071.925006:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019726336 00000100:00100000:3.0:1788851071.925053:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019726848 00000100:00100000:3.0:1788851071.925056:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019726848 00000100:00100000:3.0:1788851071.925067:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019726464 00000100:00100000:3.0:1788851071.925069:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019726464 00000100:00100000:3.0:1788851071.925077:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019726976 00000100:00100000:3.0:1788851071.925079:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019726976 00000100:00100000:3.0:1788851071.925089:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788851071.925094:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019725824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.925122:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019725824:12345-0@lo:400:kworker.0 Request processed in 28us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.925128:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788851071.925140:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788851071.925145:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019726336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.925167:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019726336:12345-0@lo:400:kworker.0 Request processed in 22us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.925171:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788851071.925188:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788851071.925192:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019726848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.925215:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019726848:12345-0@lo:400:kworker.0 Request processed in 23us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.925220:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788851071.925229:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788851071.925234:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019726464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.925253:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019726464:12345-0@lo:400:kworker.0 Request processed in 19us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.925257:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788851071.925265:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788851071.925269:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019726976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.925287:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019726976:12345-0@lo:400:kworker.0 Request processed in 18us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.925292:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1788851071.925307:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788851071.925310:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851071.925333:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019725952:0@lo:400:kworker.0 00010000:00080000:3.0:1788851071.925344:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7d14a80 x1875746019726464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851071.925353:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019726464:0@lo:400:kworker.0 00010000:00080000:3.0:1788851071.925360:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7d15880 x1875746019726976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851071.925368:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019726976:0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.925399:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019725824:0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.925408:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019726336:0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.925415:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019726848:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.925561:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019726080:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.925591:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851071.925613:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019726592:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.925644:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851071.925666:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019727104:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.925684:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851071.925701:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788851071.925706:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019725696:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.925728:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851071.925745:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019726208:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.925763:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851071.925776:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019726720:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.925793:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851071.925806:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019727232:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.925824:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851071.925844:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851071.925851:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019727360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851071.925873:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851071.925898:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019726080 00000100:00100000:2.0:1788851071.925902:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019726080 00000100:00100000:2.0:1788851071.925928:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788851071.925934:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019726080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.925968:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019726080:12345-0@lo:400:kworker.0 Request processed in 35us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851071.925974:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788851071.925996:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019726592 00000100:00100000:2.0:1788851071.926000:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019726592 00000100:00100000:2.0:1788851071.926052:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019727104 00000100:00100000:2.0:1788851071.926055:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019727104 00000100:00100000:2.0:1788851071.926076:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019726720 00000100:00100000:2.0:1788851071.926078:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019726720 00000100:00100000:2.0:1788851071.926091:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019727232 00000100:00100000:2.0:1788851071.926094:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019727232 00000100:00100000:2.0:1788851071.926106:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788851071.926112:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019726592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.926143:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019726592:12345-0@lo:400:kworker.0 Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851071.926149:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788851071.926159:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788851071.926166:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019727104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.926192:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019727104:12345-0@lo:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851071.926198:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788851071.926207:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788851071.926212:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019726720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.926235:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019726720:12345-0@lo:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851071.926240:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788851071.926249:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788851071.926254:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019727232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.926276:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019727232:12345-0@lo:400:kworker.0 Request processed in 22us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851071.926282:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1788851071.926295:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788851071.926299:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851071.926316:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019726720:0@lo:400:kworker.0 00010000:00080000:2.0:1788851071.926335:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e8707a300 x1875746019727232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851071.926344:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019727232:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.926354:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019726080:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.926362:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019726592:0@lo:400:kworker.0 00010000:00080000:2.0:1788851071.926371:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7d15180 x1875746019727104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851071.926379:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019727104:0@lo:400:kworker.0 00000100:00100000:1.0:1788851071.926534:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019727360 00000100:00100000:1.0:1788851071.926538:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019727360 00000100:00100000:1.0:1788851071.926565:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788851071.926572:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019727360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851071.926593:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851071.926634:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019727360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851071.926640:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788851071.929816:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019725696 00000100:00100000:3.0:1788851071.929832:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019725696 00000100:00100000:3.0:1788851071.929898:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788851071.929908:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019725696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851071.929999:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead750050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019725696:12345-0@lo:400:kworker.0 Request processed in 93us (4268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.930006:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788851071.930067:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851071.930083:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019727488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851071.930117:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851071.930161:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019727488 00000100:00100000:3.0:1788851071.930164:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019727488 00000100:00100000:3.0:1788851071.930190:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788851071.930197:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019727488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788851071.930212:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851071.930247:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019727488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.930253:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1788851071.930293:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8813c700 x1875746019727488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851071.930312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019727488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851071.930556:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019726208 00000100:00100000:0.0:1788851071.930561:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019726208 00000100:00100000:0.0:1788851071.930592:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788851071.930598:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019726208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851071.930637:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019726208:12345-0@lo:400:kworker.0 Request processed in 39us (4872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851071.930643:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788851071.930669:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851071.930678:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019727616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851071.930704:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851071.930729:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019727616 00000100:00100000:0.0:1788851071.930732:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019727616 00000100:00100000:0.0:1788851071.930756:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788851071.930762:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019727616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851071.930781:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851071.930812:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019727616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851071.930818:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788851071.930850:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019727616:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788851071.931104:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c36300 x1875746019727360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851071.931120:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019727360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851071.931146:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019725696:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.931155:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019726208:0@lo:400:kworker.0 00000100:00100000:2.0:1788851071.931669:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851071.937462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019727744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851071.937556:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851071.937772:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019727744 00000100:00100000:3.0:1788851071.937781:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019727744 00000100:00100000:3.0:1788851071.937835:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788851071.937845:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019727744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788851071.937879:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851071.937940:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019727744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.937948:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788851071.938137:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019727744:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788851072.180316:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851072.948628:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019727872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851072.948700:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851072.948841:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019727872 00000100:00100000:1.0:1788851072.948850:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019727872 00000100:00100000:1.0:1788851072.948905:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788851072.948915:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019727872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788851072.948950:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788851072.948999:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019727872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851072.949006:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788851072.949078:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019727872:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788851073.213672:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851074.228914:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851074.804497:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851074.804546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851074.804587:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851074.804684:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762880 00000100:00100000:1.0:1788851074.804697:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762880 00000100:00100000:1.0:1788851074.804773:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762752 00000100:00100000:1.0:1788851074.804776:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762752 00000100:00100000:1.0:1788851074.804800:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:1.0:1788851074.804822:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000762880:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851074.804914:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000762880:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 95us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851074.804922:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:1.0:1788851074.804939:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:1.0:1788851074.804946:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000762752:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851074.804970:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000762752:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851074.804992:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00080000:2.0:1788851074.805299:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851074.805304:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851074.805668:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762624 00000100:00100000:3.0:1788851074.805675:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762624 00000100:00100000:3.0:1788851074.805718:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 376 00000100:00100000:3.0:1788851074.805725:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000762624:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851074.805768:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000762624:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 44us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851074.805774:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 376 00000100:00100000:2.0:1788851074.821813:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851074.821858:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851074.821892:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851074.821986:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763008 00000100:00100000:0.0:1788851074.821996:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763008 00000100:00100000:0.0:1788851074.822110:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1788851074.822120:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2406:x1875746000763008:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:0.0:1788851074.822155:0:8447:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205b3c 00000100:00080000:0.0:1788851074.822165:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892ea7caf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851074.822205:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1788851074.822388:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+2:2406:x1875746000763008:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 269us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851074.822396:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00010000:00010000:0.0:1788851074.822452:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851074.822767:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763136 00000100:00100000:1.0:1788851074.822774:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763136 00000100:00100000:1.0:1788851074.822810:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763264 00000100:00100000:1.0:1788851074.822812:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763264 00000100:00100000:1.0:1788851074.822832:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:1.0:1788851074.822839:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000763136:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851074.822878:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000763136:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851074.822885:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:1.0:1788851074.822897:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 252 00000100:00100000:1.0:1788851074.822903:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000763264:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851074.822926:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000763264:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851074.822932:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 252 00000100:00080000:2.0:1788851074.823277:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851074.823283:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851074.823286:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851074.996442:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851075.003256:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019728000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851075.003357:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851075.003837:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019728000 00000100:00100000:0.0:1788851075.003846:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019728000 00000100:00100000:0.0:1788851075.003918:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788851075.003929:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019728000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851075.003966:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788851075.004059:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019728000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851075.004067:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788851075.004267:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019728000:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788851075.252957:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851076.276710:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851077.044446:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851077.044471:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019728128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851077.044543:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851077.044753:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019728128 00000100:00100000:2.0:1788851077.044763:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019728128 00000100:00100000:2.0:1788851077.044831:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788851077.044844:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019728128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851077.044879:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851077.044931:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019728128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851077.044939:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788851077.045165:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851077.045177:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019728256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851077.045213:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019728384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851077.045217:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851077.045254:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788851077.045312:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788851077.045348:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c55c00 x1875746019728128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851077.045376:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019728128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851077.045421:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019728768:0@lo:400:kworker.0 00000100:00100000:3.0:1788851077.045449:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019728512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851077.045458:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.045484:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019729280:0@lo:400:kworker.0 00000100:00100000:3.0:1788851077.045491:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.045511:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.045531:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019729792:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.045551:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.045569:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788851077.045574:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019728640:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.045600:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.045619:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019729152:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.045639:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.045653:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019729664:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.045670:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.045692:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019729152 00000100:00100000:1.0:1788851077.045696:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019729152 00000100:00100000:1.0:1788851077.045726:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788851077.045733:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019729152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.045769:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019729152:12345-0@lo:400:kworker.0 Request processed in 36us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851077.045775:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788851077.045797:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019728768 00000100:00100000:1.0:1788851077.045801:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019728768 00000100:00100000:1.0:1788851077.045822:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019729280 00000100:00100000:1.0:1788851077.045824:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019729280 00000100:00100000:1.0:1788851077.045841:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019729792 00000100:00100000:1.0:1788851077.045843:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019729792 00000100:00100000:1.0:1788851077.045866:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019729664 00000100:00100000:1.0:1788851077.045869:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019729664 00000100:00100000:1.0:1788851077.045883:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788851077.045888:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019728768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.045917:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019728768:12345-0@lo:400:kworker.0 Request processed in 29us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851077.045923:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788851077.045933:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788851077.045938:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019729280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.045981:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019729280:12345-0@lo:400:kworker.0 Request processed in 42us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851077.045986:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788851077.045996:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788851077.046002:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019729792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046060:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019729792:12345-0@lo:400:kworker.0 Request processed in 58us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851077.046065:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788851077.046075:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788851077.046081:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019729664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046105:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019729664:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851077.046111:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1788851077.046128:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851077.046131:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851077.046153:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019729152:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046163:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019729664:0@lo:400:kworker.0 00010000:00080000:1.0:1788851077.046182:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e8707a300 x1875746019729792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851077.046192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019729792:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046202:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019728768:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046210:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019729280:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046247:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019728640 00000100:00100000:1.0:1788851077.046251:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019728640 00000100:00100000:1.0:1788851077.046280:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788851077.046300:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019728640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046335:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019728640:12345-0@lo:400:kworker.0 Request processed in 36us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851077.046341:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788851077.046375:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019728640:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046405:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019728896:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046432:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.046451:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019729408:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046472:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.046499:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019728896 00000100:00100000:1.0:1788851077.046503:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019728896 00000100:00100000:1.0:1788851077.046524:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788851077.046530:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019728896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046563:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019728896:12345-0@lo:400:kworker.0 Request processed in 33us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851077.046579:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788851077.046614:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019728896:0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046629:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019729408 00000100:00100000:1.0:1788851077.046633:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019729408 00000100:00100000:1.0:1788851077.046658:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788851077.046664:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019729408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851077.046698:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019729408:12345-0@lo:400:kworker.0 Request processed in 34us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851077.046704:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:1.0:1788851077.046719:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788851077.046736:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87078000 x1875746019729408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851077.046746:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019729408:0@lo:400:kworker.0 00000100:00100000:3.0:1788851077.053384:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019729024:0@lo:400:kworker.0 00000100:00100000:3.0:1788851077.053455:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851077.053475:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019729536:0@lo:400:kworker.0 00000100:00100000:3.0:1788851077.053513:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851077.053716:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019728256 00000100:00100000:1.0:1788851077.053726:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019728256 00000100:00100000:1.0:1788851077.053785:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019728384 00000100:00100000:1.0:1788851077.053788:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019728384 00000100:00100000:1.0:1788851077.053807:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019728512 00000100:00100000:1.0:1788851077.053810:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019728512 00000100:00100000:1.0:1788851077.053825:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788851077.053834:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019728256:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851077.053877:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788851077.053899:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019728384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851077.053916:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788851077.053967:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851077.053972:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851077.053984:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019728384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (8729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851077.053993:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788851077.054044:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00010000:00080000:3.0:1788851077.054045:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c54000 x1875746019728384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851077.054055:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019728512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788851077.054081:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851077.054108:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019728384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851077.054138:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019728512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (8646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851077.054146:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788851077.054165:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019728512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851077.054195:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019729536 00000100:00100000:3.0:1788851077.054199:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019729536 00000100:00100000:3.0:1788851077.054228:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788851077.054235:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875746019729536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851077.054273:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875746019729536:12345-0@lo:400:kworker.0 Request processed in 38us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851077.054292:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788851077.054399:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019729536:0@lo:400:kworker.0 00000100:00100000:2.0:1788851077.054457:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019729024 00000100:00100000:2.0:1788851077.054462:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019729024 00000100:00100000:2.0:1788851077.054498:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788851077.054505:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019729024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851077.054546:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019729024:12345-0@lo:400:kworker.0 Request processed in 42us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851077.054553:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788851077.054581:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019729024:0@lo:400:kworker.0 00002000:00000024:1.0:1788851077.054681:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851077.054733:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019728256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 901us (9517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851077.054740:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788851077.054818:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019728256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851077.300785:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851078.068691:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851078.068716:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019729920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851078.068795:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851078.069189:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019729920 00000100:00100000:0.0:1788851078.069278:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019729920 00000100:00100000:0.0:1788851078.069334:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788851078.069344:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019729920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788851078.069383:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788851078.069608:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019729920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 265us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851078.069616:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788851078.074608:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019729920:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851078.325805:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851079.348732:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851079.922649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851079.922692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851079.922723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851079.922758:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851079.922784:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851079.922813:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763520 00000100:00100000:2.0:1788851079.922822:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763520 00000100:00100000:2.0:1788851079.922877:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763648 00000100:00100000:2.0:1788851079.922880:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763648 00000100:00100000:2.0:1788851079.922907:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763776 00000100:00100000:2.0:1788851079.922911:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763776 00000100:00100000:2.0:1788851079.922946:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763904 00000100:00100000:2.0:1788851079.922949:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763904 00000100:00100000:2.0:1788851079.922964:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 259 00000100:00100000:2.0:1788851079.922975:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000763520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851079.923059:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763392 00000100:00100000:0.0:1788851079.923064:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763392 00000100:00100000:2.0:1788851079.923086:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000763520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 111us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851079.923093:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 378 00000100:00100000:2.0:1788851079.923094:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 259 00000100:00100000:0.0:1788851079.923100:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000763392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851079.923125:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 260 00000100:00100000:2.0:1788851079.923132:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000763648:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851079.923132:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000763392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851079.923138:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 378 00000100:00100000:2.0:1788851079.923154:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000763648:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851079.923160:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 260 00000100:00100000:2.0:1788851079.923170:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 261 00000100:00100000:2.0:1788851079.923175:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000763776:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851079.923195:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000763776:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 20us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851079.923200:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 261 00000100:00100000:2.0:1788851079.923210:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 262 00000100:00100000:2.0:1788851079.923216:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000763904:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851079.923250:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000763904:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851079.923255:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 262 00000100:00080000:1.0:1788851079.923545:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851079.923557:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851080.116530:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851080.116557:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019730048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851080.116655:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851080.116810:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019730048 00000100:00100000:0.0:1788851080.116819:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019730048 00000100:00100000:0.0:1788851080.116890:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788851080.116902:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019730048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851080.116943:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788851080.117001:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019730048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851080.117008:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788851080.117119:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019730048:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788851080.372194:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788851081.158612:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:2.0:1788851081.158621:0:8443:0:(genops.c:885:class_export_put()) final put ffff892ea7cac800/a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:3.0:1788851081.160574:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea7cac800/a99889d1-fa00-4984-a18e-0736ff414641 for lustre-OST0000 00000020:00000080:3.0:1788851081.160646:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea7caf000 for lustre-OST0000 00010000:00010000:1.0:1788851081.400149:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851081.400806:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788851081.402683:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851082.165445:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019730176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851082.165514:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.165607:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019730304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.165639:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.165680:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019730304 00000100:00100000:3.0:1788851082.165689:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019730304 00000100:00100000:3.0:1788851082.165736:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788851082.165745:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019730304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.165809:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019730304:12345-0@lo:400:kworker.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.165816:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788851082.165864:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019730304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.165908:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019730432:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.165936:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.165983:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019730560:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166008:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.166066:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019730560 00000100:00100000:3.0:1788851082.166070:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019730560 00000100:00100000:3.0:1788851082.166095:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788851082.166101:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019730560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166136:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019730560:12345-0@lo:400:kworker.0 Request processed in 35us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.166142:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788851082.166171:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019730560:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166215:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019730688:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.166269:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019730432 00000100:00100000:3.0:1788851082.166272:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019730432 00000100:00100000:3.0:1788851082.166299:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019730688 00000100:00100000:3.0:1788851082.166302:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019730688 00000100:00100000:3.0:1788851082.166319:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788851082.166325:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019730432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166359:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019730432:12345-0@lo:400:kworker.0 Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.166373:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788851082.166387:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788851082.166392:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019730688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166424:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019730688:12345-0@lo:400:kworker.0 Request processed in 32us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.166429:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788851082.166459:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019730432:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166479:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019730688:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166503:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019730816:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166522:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.166556:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019730944:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.166573:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.166595:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019730944 00000100:00100000:3.0:1788851082.166598:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019730944 00000100:00100000:1.0:1788851082.167758:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019730816 00000100:00100000:1.0:1788851082.167765:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019730816 00000100:00100000:1.0:1788851082.167799:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788851082.167807:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019730816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851082.167866:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019730816:12345-0@lo:400:kworker.0 Request processed in 60us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851082.167872:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788851082.174276:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788851082.174309:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019730944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851082.174416:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019730944:12345-0@lo:400:kworker.0 Request processed in 124us (7839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851082.174424:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788851082.174480:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019730176 00000100:00100000:1.0:1788851082.174490:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019730176 00000100:00100000:1.0:1788851082.174550:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788851082.174557:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019730176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851082.174580:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851082.174614:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019730176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (9101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851082.174633:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1788851082.174892:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851082.174897:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851082.174916:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019731072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851082.174959:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.175050:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019730944:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.175074:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019731200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851082.175098:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.175133:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019730176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851082.175162:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019730816:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.175216:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019731072 00000100:00100000:3.0:1788851082.175221:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019731072 00000100:00100000:3.0:1788851082.175243:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019731200 00000100:00100000:3.0:1788851082.175246:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019731200 00000100:00100000:3.0:1788851082.175261:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788851082.175267:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019731072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788851082.175284:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851082.175317:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019731072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.175323:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788851082.175335:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788851082.175340:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019731200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851082.175349:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851082.175374:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019731200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.175380:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788851082.175394:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788851082.175412:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87078000 x1875746019731072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851082.175427:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019731072:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788851082.175450:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e8707b480 x1875746019731200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851082.175461:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019731200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851082.175503:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019731328:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.175527:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.175568:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019731328 00000100:00100000:3.0:1788851082.175572:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019731328 00000100:00100000:3.0:1788851082.175601:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788851082.175608:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019731328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.175718:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019731328:12345-0@lo:400:kworker.0 Request processed in 111us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.175724:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788851082.175738:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788851082.175755:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7d16680 x1875746019731328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851082.175764:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019731328:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.175796:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019731456:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.175821:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.175850:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019731456 00000100:00100000:3.0:1788851082.175854:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019731456 00000100:00100000:3.0:1788851082.175886:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788851082.175893:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019731456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.175926:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019731456:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.175932:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788851082.175945:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851082.175963:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019731456:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.175993:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019731584:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.176038:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.176067:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019731584 00000100:00100000:3.0:1788851082.176070:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019731584 00000100:00100000:3.0:1788851082.176104:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788851082.176111:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019731584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.176145:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019731584:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.176151:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1788851082.176165:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851082.176194:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019731584:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.176230:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019731712:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.176258:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.176283:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019731712 00000100:00100000:3.0:1788851082.176286:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019731712 00000100:00100000:3.0:1788851082.176313:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788851082.176319:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019731712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.176349:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019731712:12345-0@lo:400:kworker.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.176354:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788851082.176365:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788851082.176383:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8813d180 x1875746019731712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851082.176392:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019731712:0@lo:400:kworker.0 00000100:00100000:3.0:1788851082.185239:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019731840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851082.185327:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851082.185407:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019731840 00000100:00100000:3.0:1788851082.185415:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019731840 00000100:00100000:3.0:1788851082.185467:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788851082.185477:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019731840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851082.185518:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851082.185562:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019731840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851082.185570:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788851082.185637:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019731840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851082.420822:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851083.195577:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851083.195601:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019731968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851083.195686:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851083.196005:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019731968 00000100:00100000:3.0:1788851083.196041:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019731968 00000100:00100000:3.0:1788851083.196102:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788851083.196113:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019731968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851083.196149:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851083.196222:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019731968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851083.196228:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788851083.196749:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019731968:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851083.451925:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851084.468220:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851085.058167:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851085.058220:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851085.058245:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851085.058276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851085.058300:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851085.058329:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764288 00000100:00100000:0.0:1788851085.058339:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764288 00000100:00100000:0.0:1788851085.058393:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764544 00000100:00100000:0.0:1788851085.058396:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764544 00000100:00100000:0.0:1788851085.058410:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764160 00000100:00100000:0.0:1788851085.058412:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764160 00000100:00100000:0.0:1788851085.058424:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764416 00000100:00100000:0.0:1788851085.058426:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764416 00000100:00100000:0.0:1788851085.058488:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 269 00000100:00100000:0.0:1788851085.058497:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000764288:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851085.058582:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000764288:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 86us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851085.058591:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 269 00000100:00100000:0.0:1788851085.058612:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 270 00000100:00100000:0.0:1788851085.058619:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000764544:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851085.058644:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000764544:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851085.058650:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 270 00000100:00100000:0.0:1788851085.058673:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 271 00000100:00100000:0.0:1788851085.058679:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000764160:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851085.058705:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000764160:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851085.058711:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 271 00000100:00100000:0.0:1788851085.058722:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 272 00000100:00100000:0.0:1788851085.058728:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000764416:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851085.058750:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000764416:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851085.058755:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 272 00000100:00080000:0.0:1788851085.058783:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851085.058788:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851085.064275:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764032 00000100:00100000:3.0:1788851085.064292:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764032 00000100:00100000:3.0:1788851085.064359:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 380 00000100:00100000:3.0:1788851085.064371:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000764032:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851085.064457:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000764032:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 88us (6300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851085.064464:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 380 00000100:00100000:1.0:1788851085.239453:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851085.239478:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019732096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851085.239555:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851085.239646:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019732096 00000100:00100000:3.0:1788851085.239654:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019732096 00000100:00100000:3.0:1788851085.239711:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788851085.239721:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019732096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851085.239755:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788851085.239820:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019732096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851085.239827:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788851085.240373:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019732096:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788851085.492501:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851086.517762:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851087.289453:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019732224:0@lo:400:kworker.0 00000100:00100000:2.0:1788851087.289527:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851087.289581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019732352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851087.289634:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851087.289653:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019732864:0@lo:400:kworker.0 00000100:00100000:2.0:1788851087.289690:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851087.289713:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019733376:0@lo:400:kworker.0 00000100:00100000:2.0:1788851087.289750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851087.289820:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019733888:0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.289823:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019732864 00000100:00100000:3.0:1788851087.289831:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019732864 00000100:00100000:2.0:1788851087.289842:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851087.289895:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788851087.289905:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019732864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.289959:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019732864:12345-0@lo:400:kworker.0 Request processed in 55us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851087.289966:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788851087.290658:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019732736:0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.290695:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851087.290721:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019733248:0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.290747:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019732608:0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.290772:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851087.290792:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019733120:0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.290812:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851087.290830:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019733632:0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.290850:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851087.290883:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019732480:0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.290931:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851087.290949:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019732992:0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.290968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851087.290984:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019733504:0@lo:400:kworker.0 00000100:00100000:3.0:1788851087.291036:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851087.291820:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019734016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851087.291856:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851087.291922:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019732352 00000100:00100000:3.0:1788851087.291929:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019732352 00000100:00100000:3.0:1788851087.291980:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019734016 00000100:00100000:3.0:1788851087.291985:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019734016 00000100:00100000:3.0:1788851087.292005:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788851087.292036:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019732352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788851087.292062:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851087.292233:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019732352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851087.292240:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788851087.292257:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788851087.292263:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019734016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851087.292273:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851087.292303:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019734016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851087.292309:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788851087.292353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019734016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851087.292729:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019734144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851087.292751:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019732352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851087.292762:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019732864:0@lo:400:kworker.0 00000100:00100000:1.0:1788851087.292765:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851087.292784:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851087.292788:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019732224 00000100:00100000:1.0:1788851087.292790:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019734272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851087.292792:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019732224 00000100:00100000:1.0:1788851087.292812:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851087.292819:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788851087.292825:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019732224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851087.292832:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851087.292862:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019732224:12345-0@lo:400:kworker.0 Request processed in 36us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851087.292868:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788851087.293034:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019734144 00000100:00100000:2.0:1788851087.293038:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019734144 00000100:00100000:2.0:1788851087.293291:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019734272 00000100:00100000:2.0:1788851087.293296:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019734272 00000100:00100000:2.0:1788851087.293314:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788851087.293320:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019734144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851087.293336:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851087.293373:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019734144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851087.293378:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788851087.293390:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788851087.293396:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019734272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851087.293405:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851087.293427:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019734272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851087.293433:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788851087.302620:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019733376 00000100:00100000:0.0:1788851087.302637:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019733376 00000100:00100000:0.0:1788851087.302739:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019733888 00000100:00100000:0.0:1788851087.302744:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019733888 00000100:00100000:0.0:1788851087.302773:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788851087.302783:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019733376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.302898:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019733376:12345-0@lo:400:kworker.0 Request processed in 116us (13146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851087.302905:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788851087.302924:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788851087.302931:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019733888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.302961:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019733888:12345-0@lo:400:kworker.0 Request processed in 32us (13118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851087.302982:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788851087.303009:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019732736 00000100:00100000:0.0:1788851087.304700:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019732736 00000100:00100000:0.0:1788851087.304744:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019733120 00000100:00100000:0.0:1788851087.304746:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019733120 00000100:00100000:0.0:1788851087.304761:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019733632 00000100:00100000:0.0:1788851087.304764:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019733632 00000100:00100000:0.0:1788851087.304779:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019732480 00000100:00100000:0.0:1788851087.304781:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019732480 00000100:00100000:0.0:1788851087.304791:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019732992 00000100:00100000:0.0:1788851087.304793:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019732992 00000100:00100000:0.0:1788851087.304803:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019733504 00000100:00100000:0.0:1788851087.304806:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019733504 00000100:00100000:0.0:1788851087.304820:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788851087.304827:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019732736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.304905:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019732736:12345-0@lo:400:kworker.0 Request processed in 78us (14208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851087.304912:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788851087.304927:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788851087.304933:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019733120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.304961:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019733120:12345-0@lo:400:kworker.0 Request processed in 29us (14148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851087.304966:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788851087.304976:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788851087.304982:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019733632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.305009:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019733632:12345-0@lo:400:kworker.0 Request processed in 27us (14158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851087.305218:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019733760:0@lo:400:kworker.0 00000100:00100000:1.0:1788851087.305257:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851087.305294:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788851087.305295:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019732736:0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.305313:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788851087.305319:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019732480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.305356:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019732480:12345-0@lo:400:kworker.0 Request processed in 38us (14424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851087.305362:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788851087.305373:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00080000:1.0:1788851087.305374:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851087.305378:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851087.305378:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019732992:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788851087.305381:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851087.305384:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851087.305397:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788851087.305405:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019733504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.305405:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019732992:12345-0@lo:400:kworker.0 Request processed in 27us (14436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851087.305410:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788851087.305426:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019733248 00000100:00100000:0.0:1788851087.305430:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019733248 00000100:00100000:0.0:1788851087.305446:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019733760 00000100:00100000:0.0:1788851087.305448:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019733760 00000100:00100000:1.0:1788851087.305450:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019733504:12345-0@lo:400:kworker.0 Request processed in 47us (14414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851087.305456:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788851087.305458:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788851087.305463:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019733248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851087.305484:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019732608 00000100:00100000:1.0:1788851087.305488:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019732608 00000100:00100000:0.0:1788851087.305496:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019733248:12345-0@lo:400:kworker.0 Request processed in 33us (12663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851087.305502:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788851087.305511:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788851087.305511:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788851087.305516:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851087.305517:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019732608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.305543:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019733760:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851087.305549:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788851087.305559:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019732608:12345-0@lo:400:kworker.0 Request processed in 42us (14786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851087.305564:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788851087.305591:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019732480:0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.305601:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019732992:0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.305623:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019733504:0@lo:400:kworker.0 00000100:00100000:0.0:1788851087.305652:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019733248:0@lo:400:kworker.0 00010000:00080000:0.0:1788851087.305663:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca2a00 x1875746019733760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851087.305673:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019733760:0@lo:400:kworker.0 00000100:00100000:2.0:1788851087.306097:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019732224:0@lo:400:kworker.0 00000100:00100000:2.0:1788851087.306112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019733376:0@lo:400:kworker.0 00010000:00080000:2.0:1788851087.306124:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca1500 x1875746019733888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851087.306133:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019733888:0@lo:400:kworker.0 00010000:00080000:2.0:1788851087.306174:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e8707a300 x1875746019734272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851087.306190:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019734272:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788851087.306199:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87079880 x1875746019734144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851087.307524:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019734144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851087.307545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019732608:0@lo:400:kworker.0 00010000:00080000:2.0:1788851087.307558:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88151880 x1875746019733120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851087.307566:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019733120:0@lo:400:kworker.0 00010000:00080000:2.0:1788851087.307577:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca0380 x1875746019733632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851087.307586:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019733632:0@lo:400:kworker.0 00010000:00010000:2.0:1788851087.541586:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788851087.665904:0:14079:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:04:45 (1788851085) 00000100:00100000:0.0:1788851088.308976:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851088.309029:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019734400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851088.309123:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851088.309289:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019734400 00000100:00100000:3.0:1788851088.309299:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019734400 00000100:00100000:3.0:1788851088.309348:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788851088.309358:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019734400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851088.309394:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851088.309439:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019734400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851088.309462:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788851088.309674:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019734400:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851088.564557:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851089.161609:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851089.161758:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764672 00000100:00100000:2.0:1788851089.161769:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764672 00000100:00100000:2.0:1788851089.161849:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1788851089.161861:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:11119:x1875746000764672:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851089.161883:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851089.161968:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a27 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851089.162261:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154e00/0x3e0030720b205c23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851089.162275:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154e00/0x3e0030720b205c23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851089.162288:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154e00/0x3e0030720b205c23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851089.162351:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788851089.162354:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851089.162391:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154e00/0x3e0030720b205c23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851089.162414:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a27 expref: 7 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851089.162432:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154e00/0x3e0030720b205c23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a27 expref: 6 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851089.162440:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea55ec800) 00010000:00010000:2.0:1788851089.162443:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851089.162447:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2154e00, rc 0) 00000100:00080000:1.0:1788851089.162575:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851089.162625:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:11119:x1875746000764672:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 766us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851089.162632:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:3.0:1788851089.170905:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851089.171219:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764800 00000100:00100000:1.0:1788851089.171229:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764800 00000100:00100000:1.0:1788851089.171298:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:1.0:1788851089.171310:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+6:11120:x1875746000764800:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851089.171330:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851089.171350:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205c2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a2e expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171416:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171432:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171443:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171458:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171467:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171473:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171533:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205c3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171542:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205c3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171567:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205c3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851089.171607:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788851089.171611:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851089.171630:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205c3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171641:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171660:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171667:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171672:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851089.171676:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171683:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171694:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea55ec800) 00010000:00010000:1.0:1788851089.171696:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851089.171701:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171708:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171732:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171737:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171742:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171747:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851089.171750:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171755:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171761:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff892d81099200) 00010000:00010000:1.0:1788851089.171764:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851089.171767:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171772:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171803:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205c2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a2e expref: 8 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171817:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205c3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a2e expref: 7 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.171834:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff892d81099d00) 00010000:00010000:1.0:1788851089.171836:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851089.171838:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95c00, rc 0) 00000100:00100000:1.0:1788851089.171901:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+7:11120:x1875746000764800:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 593us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851089.171909:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:3.0:1788851089.175102:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851089.178000:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764928 00000100:00100000:0.0:1788851089.178035:0:6546:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764928 00000100:00100000:0.0:1788851089.178120:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:0.0:1788851089.178131:0:6546:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a99889d1-fa00-4984-a18e-0736ff414641+7:11120:x1875746000764928:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788851089.178399:0:6546:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a99889d1-fa00-4984-a18e-0736ff414641+7:11120:x1875746000764928:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 Request processed in 269us (3308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851089.178408:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1788851089.190198:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851089.190366:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765184 00000100:00100000:1.0:1788851089.190376:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765184 00000100:00100000:1.0:1788851089.190441:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:1.0:1788851089.190451:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:11120:x1875746000765184:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851089.190473:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851089.190493:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205c46 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a35 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190565:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190579:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190591:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190631:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190639:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190659:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190770:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b205c5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190779:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b205c5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190786:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b205c5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851089.190796:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788851089.190898:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190907:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190914:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190919:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851089.190924:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190931:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190943:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff892d81099d00) 00010000:00010000:1.0:1788851089.190946:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851089.190958:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.190964:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205c4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191537:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191547:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191554:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191559:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851089.191563:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191571:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191581:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff892d81099200) 00010000:00010000:1.0:1788851089.191583:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851089.191586:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191592:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205c54 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191871:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205c46 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a35 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191897:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b205c5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a35 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851089.191904:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:1.0:1788851089.191906:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851089.191909:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94a00, rc 0) 00000100:00100000:1.0:1788851089.192515:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+9:11120:x1875746000765184:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 2062us (2324us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788851089.192525:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:3.0:1788851089.221972:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851089.222525:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765312 00000100:00100000:2.0:1788851089.222536:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765312 00000100:00100000:2.0:1788851089.222605:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:2.0:1788851089.222616:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+9:11120:x1875746000765312:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788851089.222734:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+9:11120:x1875746000765312:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 119us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851089.222742:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1788851089.224533:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851089.224629:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765440 00000100:00100000:0.0:1788851089.224637:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765440 00000100:00100000:0.0:1788851089.224720:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:0.0:1788851089.224730:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:11120:x1875746000765440:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788851089.225383:0:6534:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 620us 00000100:00080000:2.0:1788851089.226648:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851089.279288:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:11120:x1875746000765440:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 54545us (54748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851089.279303:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000040:00080000:1.0:1788851089.588805:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788851089.590269:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851089.590758:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851090.167124:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851090.167160:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851090.167186:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851090.167220:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851090.167248:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851090.167278:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765568 00000100:00100000:0.0:1788851090.167289:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765568 00000100:00100000:0.0:1788851090.167336:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 382 00000100:00100000:0.0:1788851090.167346:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000765568:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851090.167417:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000765568:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851090.167425:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 382 00000100:00100000:0.0:1788851090.167456:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765696 00000100:00100000:0.0:1788851090.167459:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765696 00000100:00100000:0.0:1788851090.167483:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765952 00000100:00100000:0.0:1788851090.167486:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765952 00000100:00100000:0.0:1788851090.167505:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765824 00000100:00100000:0.0:1788851090.167507:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765824 00000100:00100000:0.0:1788851090.167518:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766080 00000100:00100000:0.0:1788851090.167521:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766080 00000100:00100000:0.0:1788851090.167535:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 279 00000100:00100000:0.0:1788851090.167541:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+9:2407:x1875746000765696:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851090.167569:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+9:2407:x1875746000765696:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851090.167576:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 279 00000100:00100000:0.0:1788851090.167587:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 280 00000100:00100000:0.0:1788851090.167593:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000765952:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851090.167628:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000765952:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851090.167635:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 280 00000100:00100000:0.0:1788851090.167646:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 281 00000100:00100000:0.0:1788851090.167651:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000765824:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851090.167670:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000765824:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 19us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851090.167676:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 281 00000100:00100000:0.0:1788851090.167684:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 282 00000100:00100000:0.0:1788851090.167689:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000766080:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851090.167707:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000766080:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 18us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851090.167713:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 282 00000100:00080000:0.0:1788851090.167810:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851090.167814:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851090.356231:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019734528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851090.356308:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851090.356425:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019734528 00000100:00100000:1.0:1788851090.356433:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019734528 00000100:00100000:1.0:1788851090.356491:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788851090.356501:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019734528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851090.356534:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788851090.356581:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019734528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851090.356589:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788851090.356994:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019734528:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788851090.617613:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851091.637730:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788851091.637869:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851091.640602:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788851091.991057:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851091.991389:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766208 00000100:00100000:3.0:1788851091.991401:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766208 00000100:00100000:3.0:1788851091.991475:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:3.0:1788851091.991486:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+9:11163:x1875746000766208:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851091.991507:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851091.991528:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205c69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a3c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991594:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991608:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991620:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991638:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991658:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991665:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991708:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991716:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991723:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991729:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851091.991734:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991741:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991751:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea55ec800) 00010000:00010000:3.0:1788851091.991754:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851091.991759:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991766:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991780:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991793:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991799:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991804:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851091.991807:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991813:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991821:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff892ea5408700) 00010000:00010000:3.0:1788851091.991825:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851091.991828:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991833:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991866:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205c69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a3c expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991877:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea55ec800) 00010000:00010000:3.0:1788851091.991879:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851091.991883:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205c69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a3c expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.991893:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031200, rc 0) 00000100:00100000:3.0:1788851091.991949:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+9:11163:x1875746000766208:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 466us (936us total) trans 0 rc 301/301 00000100:00100000:3.0:1788851091.991957:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00080000:3.0:1788851091.991979:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851091.997321:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851091.997805:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766464 00000100:00100000:2.0:1788851091.997816:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766464 00000100:00100000:2.0:1788851091.997879:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:2.0:1788851091.997889:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+9:11163:x1875746000766464:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:2.0:1788851091.997953:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851091.997985:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154e00/0x3e0030720b205c23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a27 expref: 9 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998046:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea55ec800) 00010000:00010000:2.0:1788851091.998057:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851091.998133:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998146:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998156:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998170:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998177:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998195:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998717:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998728:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998735:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851091.998749:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b83c05e reply state 000000001bafdc42 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998759:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998766:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:2.0:1788851091.998768:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851091.998771:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788851091.998775:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788851091.998781:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998788:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998795:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998800:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2155e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851091.998812:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998820:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998829:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8a8cb300) 00010000:00010000:2.0:1788851091.998831:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851091.998835:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998841:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b205c7e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851091.998857:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b83c05e reply state 000000001bafdc42 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998865:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.998871:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff892e8a8cbc00) 00010000:00010000:2.0:1788851091.998873:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851091.998875:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788851091.998990:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+10:11163:x1875746000766464:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 1099us (1676us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788851091.999047:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:2.0:1788851092.101453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.101556:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766592 00000100:00100000:3.0:1788851092.101568:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766592 00000100:00100000:3.0:1788851092.101639:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:3.0:1788851092.101661:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+10:11171:x1875746000766592:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:3.0:1788851092.101688:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851092.101712:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205c93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a43 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.101780:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.101794:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.101806:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851092.101853:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788851092.101856:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851092.101897:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.101933:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205c93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a43 expref: 12 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.101955:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a43 expref: 11 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.101981:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea5408700) 00010000:00010000:3.0:1788851092.101984:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851092.101987:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030800, rc 0) 00000100:00100000:3.0:1788851092.102122:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+11:11171:x1875746000766592:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 474us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851092.102130:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:2.0:1788851092.157128:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.157213:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766720 00000100:00100000:3.0:1788851092.157225:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766720 00000100:00100000:3.0:1788851092.157285:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:3.0:1788851092.157296:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+11:11177:x1875746000766720:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851092.157318:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851092.157341:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205ca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a4a expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157412:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157425:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157436:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157447:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157454:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157477:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157556:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b205cb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157563:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b205cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157569:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b205cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851092.157599:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788851092.157602:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851092.157641:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b205cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157661:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157668:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157674:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157680:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851092.157684:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157691:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157711:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea5408700) 00010000:00010000:3.0:1788851092.157713:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851092.157718:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157724:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157740:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157746:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157751:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157756:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851092.157758:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157763:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157770:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff892e8a8cbc00) 00010000:00010000:3.0:1788851092.157772:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851092.157774:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157779:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205caf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157814:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205ca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a4a expref: 13 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157827:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b205cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a4a expref: 12 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.157833:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:3.0:1788851092.157835:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788851092.157837:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031a00, rc 0) 00000100:00100000:3.0:1788851092.157894:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+12:11177:x1875746000766720:12345-192.168.204.27@tcp:101:bash.0 Request processed in 600us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851092.157902:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:2.0:1788851092.161581:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851092.161689:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766976 00000100:00100000:0.0:1788851092.161700:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766976 00000100:00100000:0.0:1788851092.161764:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:0.0:1788851092.161774:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+12:11177:x1875746000766976:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1788851092.161794:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851092.161829:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b205cbd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a51 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.161961:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.161976:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.161987:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.162597:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.162610:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.162618:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788851092.163198:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788851092.163360:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163373:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163381:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163412:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163430:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163438:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163443:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebac00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851092.163448:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163456:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163467:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851092.163470:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851092.163474:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163480:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b205cc4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851092.163497:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdcf2bd2 reply state 00000000d74641fe transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163507:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163513:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409900) 00010000:00010000:0.0:1788851092.163515:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851092.163518:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788851092.163552:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b205cbd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a51 expref: 15 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163571:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a51 expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.163578:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d87409600) 00010000:00010000:0.0:1788851092.163581:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851092.163583:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bda00, rc 0) 00000100:00100000:0.0:1788851092.163807:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+15:11177:x1875746000766976:12345-192.168.204.27@tcp:101:bash.0 Request processed in 2034us (2235us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788851092.163816:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:0.0:1788851092.168123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.168376:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000767104 00000100:00100000:3.0:1788851092.168388:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000767104 00000100:00100000:3.0:1788851092.168440:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1788851092.168450:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1875746000767104:12345-192.168.204.27@tcp:8:bash.0 00010000:00080000:3.0:1788851092.168489:0:8447:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:3.0:1788851092.168522:0:8447:0:(genops.c:1384:class_connect()) connect: client a99889d1-fa00-4984-a18e-0736ff414641, cookie 0x3e0030720b205ce0 00002000:00100000:3.0:1788851092.168534:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a99889d1-fa00-4984-a18e-0736ff414641/ffff892d88061000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788851092.168552:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788851092.168632:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788851092.168661:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892d88063000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851092.168737:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2406:x1875746000767104:12345-192.168.204.27@tcp:8:bash.0 Request processed in 286us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851092.168745:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:2.0:1788851092.170822:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851092.170910:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000767232 00000100:00100000:1.0:1788851092.170920:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000767232 00000100:00080000:3.0:1788851092.171110:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851092.171275:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:1.0:1788851092.171288:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:0:x1875746000767232:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1788851092.171306:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851092.171330:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a58 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851092.171375:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851092.171397:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=426s v=(0 0) 00010000:00010000:1.0:1788851092.171401:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851092.171411:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a58 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.171429:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a58 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.171443:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95e00, rc 0) 00000100:00100000:1.0:1788851092.171497:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:0:x1875746000767232:12345-192.168.204.27@tcp:101:bash.0 Request processed in 213us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.172975:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1788851092.174483:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.174582:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000767360 00000100:00100000:3.0:1788851092.174592:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000767360 00000100:00100000:3.0:1788851092.174650:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1788851092.174663:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:11177:x1875746000767360:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851092.174680:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851092.174702:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a5f expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.174734:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a58 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.174742:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851092.174746:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851092.174752:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.174787:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a58 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.174801:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a58 expref: 8 pid: 8450 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851092.174816:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8447:1875746019734656:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851092.174944:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d8685acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851092.177621:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851092.177775:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000767488 00000100:00100000:1.0:1788851092.177785:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000767488 00010000:00010000:1.0:1788851092.177829:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a58 expref: 9 pid: 8450 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851092.177878:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1788851092.177888:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+9:2408:x1875746000767488:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851092.177903:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851092.177935:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a58 expref: 9 pid: 8450 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.177968:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a58 expref: 9 pid: 8450 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.178005:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851092.178046:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851092.178055:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.178066:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.178102:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851092.178116:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6520:1875746019734784:192.168.204.27@tcp:105: 00000100:00100000:1.0:1788851092.178187:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993780 going to sleep for 11 seconds 00010000:00010000:3.0:1788851092.178775:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b205ce7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a58 expref: 9 pid: 8450 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851092.178807:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8447:1875746019734656:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851092.178833:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.178844:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031200, rc 0) 00000100:00100000:3.0:1788851092.178891:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:11177:x1875746000767360:12345-192.168.204.27@tcp:101:bash.0 Request processed in 4230us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851092.178899:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1788851092.182683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.182762:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000767744 00000100:00100000:3.0:1788851092.182771:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000767744 00000100:00100000:3.0:1788851092.182831:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:3.0:1788851092.182841:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+15:11177:x1875746000767744:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1788851092.183230:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+16:11177:x1875746000767744:12345-192.168.204.27@tcp:35:bash.0 Request processed in 390us (558us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788851092.183238:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1788851092.183897:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6520:1875746019734784:192.168.204.27@tcp:105: 00010000:00010000:1.0:1788851092.184128:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851092.184174:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000767488:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 6287us (6561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.184184:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1788851092.267106:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.267236:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768000 00000100:00100000:3.0:1788851092.267247:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768000 00000100:00100000:3.0:1788851092.267321:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1788851092.267332:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+16:11187:x1875746000768000:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851092.267360:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851092.267381:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205cf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a66 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851092.267501:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788851092.267625:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205cf5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a66 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.267640:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea5408700) 00010000:00010000:3.0:1788851092.267643:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851092.267649:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205cf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a66 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.267663:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030c00, rc 0) 00000100:00100000:3.0:1788851092.267731:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+17:11187:x1875746000768000:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 401us (635us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788851092.267738:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:2.0:1788851092.271438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.271701:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768256 00000100:00100000:3.0:1788851092.271714:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768256 00000100:00100000:3.0:1788851092.271768:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851092.271778:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+17:11187:x1875746000768256:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851092.272005:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+18:11187:x1875746000768256:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 228us (577us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788851092.272053:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1788851092.347427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851092.347528:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768384 00000100:00100000:0.0:1788851092.347537:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768384 00000100:00100000:0.0:1788851092.347598:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:0.0:1788851092.347608:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+18:11193:x1875746000768384:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851092.347630:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851092.347651:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd600/0x3e0030720b205d03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a6d expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.347719:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205d0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.347733:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.347764:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851092.347813:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788851092.347816:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851092.347838:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205d0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.347864:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd600/0x3e0030720b205d03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a6d expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.347882:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205d0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a6d expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.347890:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851092.347892:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851092.347896:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bce00, rc 0) 00000100:00100000:0.0:1788851092.348332:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+19:11193:x1875746000768384:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 723us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851092.348339:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:2.0:1788851092.351774:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851092.352600:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768640 00000100:00100000:0.0:1788851092.352611:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768640 00000100:00100000:0.0:1788851092.352679:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1788851092.352688:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+19:11193:x1875746000768640:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851092.352708:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851092.352728:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205d11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a74 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.352854:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205d18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.352867:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205d18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.352879:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205d18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851092.352891:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788851092.353540:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205d11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a74 expref: 22 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.353560:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205d18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a74 expref: 21 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.353569:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d87409600) 00010000:00010000:0.0:1788851092.353572:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851092.353576:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bd200, rc 0) 00000100:00100000:0.0:1788851092.353687:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+21:11193:x1875746000768640:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 999us (1921us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788851092.353695:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1788851092.365297:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851092.365342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.365414:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769024 00000100:00100000:3.0:1788851092.365425:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769024 00000100:00100000:3.0:1788851092.365478:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1788851092.365488:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+21:11193:x1875746000769024:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851092.365512:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851092.365530:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205d26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a7b expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.365669:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205d2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.365685:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205d2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.365697:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205d2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851092.365719:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788851092.365814:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205d26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a7b expref: 24 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.365832:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205d2d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a7b expref: 23 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.365840:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d87409600) 00010000:00010000:3.0:1788851092.365843:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788851092.365846:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030400, rc 0) 00000100:00100000:3.0:1788851092.365944:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+23:11193:x1875746000769024:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 457us (600us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788851092.365951:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:1.0:1788851092.366781:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768768 00000100:00100000:1.0:1788851092.366788:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768768 00000100:00100000:1.0:1788851092.366829:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1788851092.366837:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+23:2410:x1875746000768768:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851092.366857:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851092.366874:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205d18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a74 expref: 23 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.366887:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d87409600) 00010000:00010000:1.0:1788851092.366891:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851092.366929:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+22:2410:x1875746000768768:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 93us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.366936:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:2.0:1788851092.378960:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.379087:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769152 00000100:00100000:3.0:1788851092.379100:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769152 00000100:00100000:3.0:1788851092.379180:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1788851092.379191:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000769152:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:3.0:1788851092.379240:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.379275:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.379283:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851092.379288:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851092.379293:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.379331:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.379345:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 7 pid: 8447 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851092.379360:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1875746019734912:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851092.379637:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d8685a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788851092.383698:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.383817:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1875746019734912:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851092.383846:0:8625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851092.391154:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769280 00000100:00100000:1.0:1788851092.391172:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769280 00002000:00100000:1.0:1788851092.391227:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff892ea7ca2a00 x1875746000769280/t0(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:158/0 lens 504/0 e 0 to 0 dl 1788851103 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851092.391239:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea7ca2a00 with x1875746000769280 ext(0->12) 00010000:00010000:1.0:1788851092.391248:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 8 pid: 8447 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.391265:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 8 pid: 8447 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851092.391274:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff892ea7ca2a00 00000100:00100000:1.0:1788851092.391311:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:1.0:1788851092.391323:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000769280:12345-192.168.204.27@tcp:4:lfs.0 00000001:00100000:1.0:1788851092.395179:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000100:00100000:1.0:1788851092.404452:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851092.404485:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019735040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851092.404551:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.405235:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851092.405246:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019735168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851092.405279:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.405311:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019735040 00000100:00100000:2.0:1788851092.405319:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019735040 00000100:00100000:2.0:1788851092.405370:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019735168 00000100:00100000:2.0:1788851092.405372:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019735168 00000100:00100000:2.0:1788851092.405388:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788851092.405395:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019735040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851092.405417:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851092.405455:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019735040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.405461:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788851092.405476:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788851092.405482:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019735168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851092.405490:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851092.405514:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019735168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.405520:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788851092.405559:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019735040:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788851092.405584:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851092.405616:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019735168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851092.405898:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019735424:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.405932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851092.405951:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019735936:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.405969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851092.405997:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019736448:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406048:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851092.406065:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788851092.406071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019735296:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406097:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851092.406118:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019735808:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406140:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851092.406175:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019736320:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406199:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851092.406224:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019735808 00000100:00100000:1.0:1788851092.406229:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019735808 00000100:00100000:1.0:1788851092.406257:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788851092.406264:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019735808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406300:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019735808:12345-0@lo:400:kworker.0 Request processed in 37us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.406306:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788851092.406338:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019735808:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406360:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019736320 00000100:00100000:1.0:1788851092.406363:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019736320 00000100:00100000:1.0:1788851092.406405:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788851092.406411:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019736320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406444:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019736320:12345-0@lo:400:kworker.0 Request processed in 33us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.406449:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788851092.406471:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019736320:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406488:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019735424 00000100:00100000:1.0:1788851092.406491:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019735424 00000100:00100000:1.0:1788851092.406531:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019735936 00000100:00100000:1.0:1788851092.406534:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019735936 00000100:00100000:1.0:1788851092.406551:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019736448 00000100:00100000:1.0:1788851092.406553:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019736448 00000100:00100000:1.0:1788851092.406567:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788851092.406573:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019735424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406606:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019735424:12345-0@lo:400:kworker.0 Request processed in 33us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.406611:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788851092.406622:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788851092.406628:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019735936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406654:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019735936:12345-0@lo:400:kworker.0 Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.406660:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788851092.406670:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788851092.406676:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019736448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406700:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019736448:12345-0@lo:400:kworker.0 Request processed in 25us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.406715:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788851092.406742:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019735424:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406752:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019735936:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.406760:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019736448:0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.407421:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019735552:0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.407463:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.407500:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019736064:0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.407522:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.407539:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019736576:0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.407557:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.407576:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788851092.407582:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019735680:0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.407603:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.407620:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019736192:0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.407640:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.407671:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019735296 00000100:00100000:2.0:1788851092.407676:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019735296 00000100:00100000:2.0:1788851092.407710:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788851092.407719:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019735296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.407758:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8981c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019735296:12345-0@lo:400:kworker.0 Request processed in 41us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.407764:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00080000:2.0:1788851092.407789:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851092.407794:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851092.407816:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019735296:0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.407839:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019736192 00000100:00100000:2.0:1788851092.407842:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019736192 00000100:00100000:2.0:1788851092.407874:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788851092.407880:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019736192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.407925:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019736192:12345-0@lo:400:kworker.0 Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.407932:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788851092.407947:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851092.407963:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019736192:0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.408000:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019736064 00000100:00100000:2.0:1788851092.408004:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019736064 00000100:00100000:2.0:1788851092.409186:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019736576 00000100:00100000:2.0:1788851092.409195:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019736576 00000100:00100000:2.0:1788851092.409214:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019735680 00000100:00100000:2.0:1788851092.409217:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019735680 00000100:00100000:2.0:1788851092.409232:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788851092.409240:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019736064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.409309:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019736064:12345-0@lo:400:kworker.0 Request processed in 69us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.409315:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788851092.409330:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788851092.409336:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019736576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.409364:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019736576:12345-0@lo:400:kworker.0 Request processed in 28us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.409370:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788851092.409381:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788851092.409386:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019735680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851092.409412:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019735680:12345-0@lo:400:kworker.0 Request processed in 26us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.409418:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:2.0:1788851092.409452:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851092.409485:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019735680:0@lo:400:kworker.0 00010000:00080000:2.0:1788851092.409501:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e1bb80 x1875746019736064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851092.409512:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019736064:0@lo:400:kworker.0 00010000:00080000:2.0:1788851092.409522:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c31f80 x1875746019736576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851092.409531:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019736576:0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.410048:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019735552 00000100:00100000:1.0:1788851092.410055:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019735552 00000100:00100000:1.0:1788851092.410089:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788851092.410096:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019735552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851092.410168:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019735552:12345-0@lo:400:kworker.0 Request processed in 73us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.410175:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788851092.410208:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019735552:0@lo:400:kworker.0 00000100:00100000:3.0:1788851092.410545:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019736704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851092.410588:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.410722:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851092.410732:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019736832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851092.410762:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.410790:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019736704 00000100:00100000:2.0:1788851092.410793:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019736704 00000100:00100000:2.0:1788851092.410815:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019736832 00000100:00100000:2.0:1788851092.410817:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019736832 00000100:00100000:2.0:1788851092.410827:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788851092.410832:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019736704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788851092.410852:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851092.410880:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019736704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.410886:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788851092.410895:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788851092.410900:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019736832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851092.410908:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851092.410929:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019736832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 29us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.410946:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788851092.410978:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019736832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851092.411291:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019736704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851092.414504:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+9:2407:x1875746000769280:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 23172us (30804us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788851092.414524:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00002000:00100000:2.0:1788851092.414538:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff892ea7ca2a00 x1875746000769280/t4294967300(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:158/0 lens 504/448 e 0 to 0 dl 1788851103 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788851092.414548:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea7ca2a00 with x1875746000769280 ext(0->12) 00010000:00010000:2.0:1788851092.414559:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 9 pid: 8447 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.414577:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 9 pid: 8447 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851092.414584:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff892ea7ca2a00 00000100:00100000:2.0:1788851092.417286:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.417388:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769408 00000100:00100000:3.0:1788851092.417413:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769408 00010000:00010000:3.0:1788851092.417456:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 9 pid: 8447 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851092.417503:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1788851092.417514:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+9:2408:x1875746000769408:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851092.417530:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788851092.417551:0:7476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788851092.417555:0:7476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788851091 00002000:00010000:3.0:1788851092.417558:0:7476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788851091 00002000:00010000:3.0:1788851092.417560:0:7476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788851091 00002000:00010000:3.0:1788851092.417562:0:7476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788851092.417568:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 9 pid: 8447 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.417582:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 9 pid: 8447 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.417612:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b205cee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a5f expref: 9 pid: 8447 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.417648:0:7476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851092.417653:0:7476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851092.417660:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.417670:0:7476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.417720:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851092.417783:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000769408:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 271us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851092.417791:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00010000:00010000:2.0:1788851092.417908:0:8625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.417918:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.417939:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.417957:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.417966:0:8625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.417973:0:8625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851092.417977:0:8625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.417995:0:8625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.418050:0:8625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.418060:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b205d3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851092.418122:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000769152:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 38933us (39172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.418130:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1788851092.423239:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851092.423411:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769664 00000100:00100000:3.0:1788851092.423423:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769664 00000100:00100000:3.0:1788851092.423488:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1788851092.423498:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+22:11193:x1875746000769664:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:3.0:1788851092.423565:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205d2d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a7b expref: 22 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851092.423803:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788851092.423857:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788851092.424266:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788851092.424307:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.424325:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a51 expref: 26 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.424334:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.424374:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a51 expref: 26 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.424388:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a51 expref: 26 pid: 6536 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851092.424411:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6537:1875746019736960:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851092.424509:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf540 going to sleep for 11 seconds 00000100:00100000:0.0:1788851092.451544:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851092.451945:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769792 00000100:00100000:1.0:1788851092.451957:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769792 00010000:00010000:1.0:1788851092.452047:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a51 expref: 27 pid: 6536 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851092.452090:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1788851092.452100:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+27:2407:x1875746000769792:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851092.452115:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851092.452121:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a51 expref: 27 pid: 6536 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.452135:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a51 expref: 27 pid: 6536 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.452179:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d87409600) 00010000:00010000:1.0:1788851092.452185:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.452194:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.452202:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.452220:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851092.452273:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+27:2407:x1875746000769792:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 175us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.452280:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00010000:00010000:3.0:1788851092.454065:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205cd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a51 expref: 26 pid: 6536 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851092.454094:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6537:1875746019736960:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851092.454121:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.454378:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.454407:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851092.454525:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1788851092.454642:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788851092.454742:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8a5e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019737088:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851092.454811:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.454846:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead45ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788851092.459805:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019737088 00000100:00100000:1.0:1788851092.459822:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019737088 00000100:00100000:1.0:1788851092.459889:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788851092.459899:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6537:x1875746019737088:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788851092.460099:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6537:x1875746019737088:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 200us (5287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.460107:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788851092.460275:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8a5e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019737088:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788851092.460469:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788851092.460544:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019737216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851092.460587:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851092.460628:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788851092.460815:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019737216 00000100:00100000:3.0:1788851092.460821:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019737216 00000100:00100000:3.0:1788851092.460863:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788851092.460871:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875746019737216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788851092.461010:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6537:x1875746019737216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 139us (423us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788851092.461350:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788851092.461467:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019737216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788851092.461522:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788851092.461561:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.461571:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.461579:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.461586:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851092.461590:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.461627:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.461644:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d87409600) 00010000:00010000:2.0:1788851092.461647:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788851092.461653:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.461660:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205d42 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851092.461765:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788851092.461822:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788851092.461832:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426520819157ns, next at 427520817162ns, rc = 0 00000001:00080000:2.0:1788851092.461838:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788851092.461859:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d87409600) 00010000:00010000:2.0:1788851092.461862:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788851092.461868:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205d2d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a7b expref: 30 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851092.461979:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+29:11193:x1875746000769664:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 38482us (38749us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788851092.461998:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000020:00080000:2.0:1788851092.462002:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788851092.464795:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851092.464897:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769920 00000100:00100000:1.0:1788851092.464907:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769920 00000100:00100000:1.0:1788851092.464967:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1788851092.464976:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+29:11193:x1875746000769920:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851092.465046:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851092.465075:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205d49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a82 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.465165:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205d49 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a82 expref: 30 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.465181:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205d49 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a82 expref: 30 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.465202:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851092.465205:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851092.465208:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94200, rc 0) 00000100:00100000:1.0:1788851092.465264:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+30:11193:x1875746000769920:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 289us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.465272:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1788851092.472379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851092.472745:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000770176 00000100:00100000:0.0:1788851092.472757:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000770176 00000100:00100000:0.0:1788851092.472820:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1788851092.472831:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ec1c5e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+30:11193:x1875746000770176:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1788851092.473648:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ec1c5e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+31:11193:x1875746000770176:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 814us (1275us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788851092.473659:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:1.0:1788851092.591644:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851092.591805:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000770432 00000100:00100000:2.0:1788851092.591818:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000770432 00000100:00100000:2.0:1788851092.591886:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:2.0:1788851092.591896:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+31:11203:x1875746000770432:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851092.591938:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851092.591962:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205d50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a89 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851092.592147:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788851092.592267:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205d50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a89 expref: 33 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.592283:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea5408700) 00010000:00010000:2.0:1788851092.592286:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851092.592292:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a89 expref: 33 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.592308:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7000, rc 0) 00000100:00100000:2.0:1788851092.592383:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+32:11203:x1875746000770432:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 488us (750us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788851092.592391:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1788851092.598587:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851092.598792:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000770560 00000100:00100000:0.0:1788851092.598801:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000770560 00000100:00100000:0.0:1788851092.598861:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1788851092.598870:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+32:11203:x1875746000770560:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:0.0:1788851092.598957:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.598975:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.598996:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599046:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599054:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599060:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599150:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599159:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599183:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851092.599234:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599246:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599252:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599258:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599264:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851092.599268:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599275:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599286:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851092.599289:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851092.599294:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599300:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599312:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599323:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599328:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599332:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851092.599335:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599340:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599347:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409900) 00010000:00010000:0.0:1788851092.599349:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851092.599352:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599357:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599366:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599373:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599379:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599383:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851092.599392:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599399:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599408:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851092.599410:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851092.599412:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.599418:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851092.599496:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+32:11203:x1875746000770560:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 625us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851092.599503:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1788851092.606604:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851092.606702:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000770816 00000100:00100000:2.0:1788851092.606714:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000770816 00000100:00100000:2.0:1788851092.606774:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:2.0:1788851092.606784:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+32:11203:x1875746000770816:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1788851092.607313:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+33:11203:x1875746000770816:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 530us (718us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788851092.607321:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00010000:00010000:3.0:1788851092.662883:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851092.669148:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851092.669308:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771072 00000100:00100000:0.0:1788851092.669319:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771072 00000100:00100000:0.0:1788851092.669383:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:0.0:1788851092.669393:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+33:11206:x1875746000771072:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851092.669419:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851092.669439:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a90 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669515:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669530:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669557:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669569:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669576:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669583:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669703:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669711:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669718:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851092.669728:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788851092.669804:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669811:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669819:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669825:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851092.669835:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669843:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669856:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851092.669859:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851092.669864:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669871:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205d7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669883:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669889:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669894:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669900:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851092.669902:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669908:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669914:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409900) 00010000:00010000:0.0:1788851092.669916:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851092.669938:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669945:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205d81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.669992:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205d73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a90 expref: 36 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.670006:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a90 expref: 35 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.670086:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851092.670089:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851092.670092:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bca00, rc 0) 00000100:00100000:0.0:1788851092.670163:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+35:11206:x1875746000771072:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 771us (1033us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788851092.670171:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1788851092.673785:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851092.677853:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771200 00000100:00100000:1.0:1788851092.677869:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771200 00000100:00100000:1.0:1788851092.677955:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1788851092.677966:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+35:11206:x1875746000771200:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1788851092.678080:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.678471:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.678487:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.678551:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.678558:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.678565:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.678571:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851092.678575:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.678583:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.678595:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851092.678598:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851092.678602:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.678609:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205d96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851092.678692:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+35:11206:x1875746000771200:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 727us (4916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.678700:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1788851092.682661:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851092.683338:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771456 00000100:00100000:0.0:1788851092.683350:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771456 00000100:00100000:0.0:1788851092.683419:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:0.0:1788851092.683428:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+35:11206:x1875746000771456:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1788851092.683665:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+36:11206:x1875746000771456:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 238us (1013us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788851092.683673:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:2.0:1788851093.070957:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851093.071067:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771712 00000100:00100000:3.0:1788851093.071080:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771712 00000100:00100000:3.0:1788851093.071174:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1788851093.071187:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+36:11237:x1875746000771712:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:3.0:1788851093.071216:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851093.071249:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205d9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a97 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.071378:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205da4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.071394:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205da4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.071409:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205da4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851093.071422:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788851093.071548:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205d9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a97 expref: 39 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.071568:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205da4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a97 expref: 38 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.071576:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:3.0:1788851093.071579:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851093.071582:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031400, rc 0) 00000100:00080000:2.0:1788851093.071831:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851093.074118:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+38:11237:x1875746000771712:12345-192.168.204.27@tcp:101:cat.0 Request processed in 2920us (3162us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788851093.074133:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1788851093.080041:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851093.080144:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771968 00000100:00100000:0.0:1788851093.080156:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771968 00000100:00100000:0.0:1788851093.080217:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1788851093.080228:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+38:11237:x1875746000771968:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:0.0:1788851093.080533:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+39:11237:x1875746000771968:12345-192.168.204.27@tcp:35:cat.0 Request processed in 307us (524us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788851093.080542:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1788851093.085644:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851093.085752:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772096 00000100:00100000:0.0:1788851093.085763:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772096 00000100:00100000:0.0:1788851093.085833:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1788851093.085846:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+39:2408:x1875746000772096:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851093.085869:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851093.085896:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205da4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a97 expref: 39 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851093.085915:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851093.086431:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851093.086499:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+38:2408:x1875746000772096:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 656us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851093.086508:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:1.0:1788851093.195124:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851093.195198:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772352 00000100:00100000:2.0:1788851093.195209:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772352 00000100:00100000:2.0:1788851093.195268:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1788851093.195278:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+38:11243:x1875746000772352:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:2.0:1788851093.195302:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851093.195305:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788851093.195331:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205d0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a6d expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.195352:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:2.0:1788851093.195357:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851093.195371:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205db2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38a9e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.195479:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.195495:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a90 expref: 38 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.195503:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.195536:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a90 expref: 38 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.195550:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a90 expref: 38 pid: 10526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851093.195578:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019737344:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851093.195697:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788851093.202892:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851093.203242:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772480 00000100:00100000:1.0:1788851093.203253:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772480 00010000:00010000:1.0:1788851093.203293:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a90 expref: 39 pid: 10526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851093.203335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:1.0:1788851093.203345:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+39:2408:x1875746000772480:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851093.203362:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851093.203369:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a90 expref: 39 pid: 10526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.203384:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a90 expref: 39 pid: 10526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.203406:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851093.203412:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.203421:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.203429:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.203451:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851093.203521:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+39:2408:x1875746000772480:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 177us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851093.203529:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00010000:00010000:2.0:1788851093.204538:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205d88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a90 expref: 38 pid: 10526 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851093.204563:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019737344:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851093.204593:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.204603:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.204610:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851093.204630:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788851093.204819:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205db2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a9e expref: 39 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.204836:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a9e expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.204845:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:2.0:1788851093.204848:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851093.204851:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7000, rc 0) 00000100:00100000:2.0:1788851093.204896:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+38:11243:x1875746000772352:12345-192.168.204.27@tcp:101:dd.0 Request processed in 9619us (9780us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788851093.204918:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:1.0:1788851093.211721:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851093.212371:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772608 00000100:00100000:2.0:1788851093.212382:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772608 00000100:00100000:3.0:1788851093.212549:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:3.0:1788851093.212560:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+38:11243:x1875746000772608:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:3.0:1788851093.212594:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851093.212614:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205dc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38aa5 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.212671:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.212686:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.212697:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.212809:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205dc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aa5 expref: 40 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.212829:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aa5 expref: 39 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.212837:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:3.0:1788851093.212839:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851093.212843:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031400, rc 0) 00000100:00100000:3.0:1788851093.212946:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+39:11243:x1875746000772608:12345-192.168.204.27@tcp:101:dd.0 Request processed in 386us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851093.212953:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1788851093.217385:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851093.217460:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772864 00000100:00100000:3.0:1788851093.217469:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772864 00000100:00100000:3.0:1788851093.217539:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:3.0:1788851093.217550:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+39:11243:x1875746000772864:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:3.0:1788851093.217895:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.217991:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.218160:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851093.218211:0:9543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788851093.218238:0:9543:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ef4e63f reply state 000000005dd2ae98 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.218251:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.218259:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:3.0:1788851093.218262:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851093.218266:0:9543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851093.218425:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+42:11243:x1875746000772864:12345-192.168.204.27@tcp:36:dd.0 Request processed in 875us (1048us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788851093.218435:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000020:00080000:3.0:1788851093.218441:0:9543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788851093.428329:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851093.428353:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e90054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019737472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851093.428440:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851093.429096:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019737472 00000100:00100000:1.0:1788851093.429105:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019737472 00000100:00100000:1.0:1788851093.429163:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788851093.429172:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019737472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788851093.429207:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788851093.432048:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019737472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2865us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851093.432063:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788851093.436599:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e90054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019737472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788851093.684272:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851093.752580:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851093.752697:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772992 00000100:00100000:1.0:1788851093.752708:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772992 00000100:00100000:1.0:1788851093.752770:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:1.0:1788851093.752781:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+42:11257:x1875746000772992:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:1.0:1788851093.752804:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851093.752827:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205ddc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38aac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.752895:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.752909:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.752920:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.752931:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.752938:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.752971:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.753290:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.753302:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a9e expref: 43 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.753310:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.753345:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a9e expref: 43 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.753359:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a9e expref: 43 pid: 6534 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851093.753373:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019737600:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851093.753867:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851093.768659:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851093.768744:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000773248 00000100:00100000:2.0:1788851093.768754:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000773248 00000100:00100000:0.0:1788851093.768781:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019737600:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851093.768807:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851093.768809:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1788851093.768817:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+44:6190:x1875746000773248:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788851093.769196:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+45:6190:x1875746000773248:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 378us (552us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788851093.769204:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1788851093.771752:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851093.771860:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000773376 00000100:00100000:2.0:1788851093.771870:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000773376 00010000:00010000:2.0:1788851093.771917:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a9e expref: 45 pid: 6534 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851093.772118:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:2.0:1788851093.772128:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+45:2407:x1875746000773376:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851093.772143:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851093.772150:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a9e expref: 45 pid: 6534 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.772163:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a9e expref: 45 pid: 6534 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.772183:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205db9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a9e expref: 45 pid: 6534 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.772212:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:2.0:1788851093.772217:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.772226:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.772234:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.772273:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851093.772326:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+44:2407:x1875746000773376:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 199us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851093.772332:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00010000:00010000:1.0:1788851093.772387:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772396:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851093.772443:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788851093.772447:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851093.772496:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772512:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772521:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772527:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772534:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772539:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851093.772543:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772550:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772558:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:1.0:1788851093.772560:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851093.772564:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772569:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205de3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772580:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772585:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772594:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772599:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851093.772602:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772607:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772614:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409900) 00010000:00010000:1.0:1788851093.772616:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851093.772618:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772623:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205dea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772651:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205ddc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aac expref: 44 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772664:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aac expref: 43 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.772671:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851093.772673:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851093.772675:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95000, rc 0) 00000100:00100000:1.0:1788851093.772697:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+43:11257:x1875746000772992:12345-192.168.204.27@tcp:101:stat.0 Request processed in 19920us (20128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851093.772711:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:3.0:1788851093.884699:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851093.884810:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000773632 00000100:00100000:1.0:1788851093.884820:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000773632 00000100:00100000:1.0:1788851093.884893:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1788851093.884904:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+43:11263:x1875746000773632:12345-192.168.204.27@tcp:36:truncate.0 00010000:00010000:1.0:1788851093.884974:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851093.885001:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205df1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aac expref: 43 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.885067:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851093.885085:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851093.885252:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.885279:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.885289:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851093.885331:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1788851093.885352:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0c7f9d1 reply state 0000000061e07c63 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.885364:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.885370:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851093.885373:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788851093.885391:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851093.885506:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+45:11263:x1875746000773632:12345-192.168.204.27@tcp:36:truncate.0 Request processed in 602us (816us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788851093.885514:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000020:00080000:1.0:1788851093.885518:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788851094.094607:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851094.094824:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000773760 00000100:00100000:1.0:1788851094.094834:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000773760 00000100:00100000:1.0:1788851094.094895:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:1.0:1788851094.094904:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+45:11277:x1875746000773760:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:1.0:1788851094.094929:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851094.094949:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205dff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ab3 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095062:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095088:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095109:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095124:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095131:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095136:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095214:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095248:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095460:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851094.095505:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788851094.095509:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851094.095527:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095539:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095548:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095554:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095560:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095565:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851094.095570:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095577:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095588:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:1.0:1788851094.095597:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851094.095603:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095609:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095636:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095643:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095649:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095654:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851094.095657:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095663:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095671:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409900) 00010000:00010000:1.0:1788851094.095674:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851094.095677:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095682:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095711:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b205dff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ab3 expref: 47 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095736:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ab3 expref: 46 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.095743:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851094.095745:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851094.095748:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95a00, rc 0) 00000100:00100000:1.0:1788851094.095820:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+46:11277:x1875746000773760:12345-192.168.204.27@tcp:101:stat.0 Request processed in 916us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851094.095827:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:1.0:1788851094.246604:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851094.246911:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774016 00000100:00100000:0.0:1788851094.246934:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774016 00000100:00100000:0.0:1788851094.247046:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:0.0:1788851094.247058:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+46:11287:x1875746000774016:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851094.247089:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851094.247126:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38aba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851094.247221:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788851094.248061:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aba expref: 48 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.248971:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea5408700) 00010000:00010000:0.0:1788851094.248975:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851094.248983:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aba expref: 48 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.248999:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc400, rc 0) 00000100:00100000:0.0:1788851094.250384:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+47:11287:x1875746000774016:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 3321us (3783us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788851094.250395:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000001:00080000:1.0:1788851094.251876:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:1.0:1788851094.252380:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788851094.254984:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255003:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255068:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255076:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2154800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851094.255080:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255089:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255118:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff892e8a8cbc00) 00010000:00010000:3.0:1788851094.255122:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851094.255126:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255132:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b205c85 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255158:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255164:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255170:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255175:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851094.255178:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255195:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255204:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:3.0:1788851094.255206:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851094.255209:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255215:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205c8c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255232:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255239:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255245:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255263:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851094.255266:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255272:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255280:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409900) 00010000:00010000:3.0:1788851094.255283:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851094.255286:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255300:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205ccb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255318:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255324:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255330:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255335:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851094.255338:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255344:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255353:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:3.0:1788851094.255355:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851094.255358:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255365:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205dd5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255377:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255384:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255398:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255403:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851094.255406:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255413:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255420:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:3.0:1788851094.255423:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851094.255426:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.255431:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205df8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851094.262049:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851094.262287:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774272 00000100:00100000:2.0:1788851094.262301:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774272 00000100:00100000:2.0:1788851094.262372:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:2.0:1788851094.262383:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+28:11287:x1875746000774272:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1788851094.262637:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+29:11287:x1875746000774272:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 255us (629us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788851094.262644:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1788851094.263470:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851094.263489:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019737728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788851094.263541:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788851094.263697:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff892ec1c9d000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788851094.263702:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892e83e04000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff892ec1c9dcc0 00000020:00080000:1.0:1788851094.263706:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892e83e04600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff892d87b37200 00000020:00080000:0.0:1788851094.264487:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788851094.264674:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788851094.264697:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019737728 00000100:00100000:0.0:1788851094.264706:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019737728 00000100:00100000:0.0:1788851094.264803:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788851094.264812:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019737728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788851094.264838:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788851094.264881:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9fb393, atime: 0x6a9fb393, ctime: 0x6a9fb393, blocks: 0x8 00010000:00010000:0.0:1788851094.264889:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.264906:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1788851094.264911:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851094.264917:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.264934:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.264945:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.264961:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.264980:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788851094.267498:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1875746019737728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2680us (3949us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788851094.267511:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788851094.267554:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851094.267563:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.267575:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851094.267592:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.267603:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851094.268250:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892ea7ca1c00/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788851094.268261:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019737728:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788851094.268501:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.268510:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b205e29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.268534:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851094.268536:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851094.268537:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788851094.274044:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851094.363660:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851094.363835:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774528 00000100:00100000:0.0:1788851094.363846:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774528 00000100:00100000:0.0:1788851094.363918:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1788851094.363928:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+13:11293:x1875746000774528:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1788851094.363961:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851094.364175:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e30 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ac1 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.364289:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.364305:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ab3 expref: 14 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.364334:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.364370:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ab3 expref: 14 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.364384:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ab3 expref: 14 pid: 9543 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851094.364397:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019737856:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851094.364505:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788851094.366662:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019737856:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851094.366691:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851094.375447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851094.375569:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774656 00000100:00100000:1.0:1788851094.375579:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774656 00010000:00010000:1.0:1788851094.375620:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ab3 expref: 15 pid: 9543 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851094.375677:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:1.0:1788851094.375686:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+15:2408:x1875746000774656:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851094.375702:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851094.375709:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ab3 expref: 15 pid: 9543 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.375741:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ab3 expref: 15 pid: 9543 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.375763:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ab3 expref: 15 pid: 9543 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.375780:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851094.375786:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.375797:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.375805:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.375838:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851094.375901:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+14:2408:x1875746000774656:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 216us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851094.375908:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00010000:00010000:3.0:1788851094.377507:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.377521:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851094.377554:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788851094.377697:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac1 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.377716:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac1 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.377724:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:3.0:1788851094.377727:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851094.377730:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc000, rc 0) 00000100:00100000:3.0:1788851094.377811:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+14:11293:x1875746000774528:12345-192.168.204.27@tcp:101:bash.0 Request processed in 13883us (14172us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788851094.377818:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1788851094.392997:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851094.394689:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774912 00000100:00100000:0.0:1788851094.394704:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774912 00000100:00100000:0.0:1788851094.394782:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:0.0:1788851094.394795:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+14:11293:x1875746000774912:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:0.0:1788851094.395096:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.395115:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.395126:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851094.395189:0:10526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1788851094.395210:0:10526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c517c52 reply state 0000000053b11232 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.395222:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.395230:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851094.395233:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851094.395237:0:10526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851094.395341:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+17:11293:x1875746000774912:12345-192.168.204.27@tcp:36:bash.0 Request processed in 548us (2353us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788851094.395349:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000020:00080000:0.0:1788851094.395354:0:10526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788851094.407119:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851094.407723:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775040 00000100:00100000:0.0:1788851094.407733:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775040 00000100:00100000:0.0:1788851094.407788:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:0.0:1788851094.407797:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+17:11293:x1875746000775040:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1788851094.407820:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851094.407841:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ac8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.407963:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.407987:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac1 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.408054:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.408092:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac1 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.408105:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac1 expref: 18 pid: 6535 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851094.408120:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019737984:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851094.408206:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788851094.419545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851094.419661:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775168 00000100:00100000:1.0:1788851094.419672:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775168 00010000:00010000:1.0:1788851094.419713:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac1 expref: 19 pid: 6535 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851094.419759:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1788851094.419785:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:2407:x1875746000775168:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851094.419801:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851094.419808:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac1 expref: 19 pid: 6535 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.419822:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac1 expref: 19 pid: 6535 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.419844:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851094.419848:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.419858:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.419866:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.419894:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851094.420213:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:2407:x1875746000775168:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 430us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851094.420221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00010000:00010000:0.0:1788851094.421204:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e37 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac1 expref: 18 pid: 6535 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851094.421225:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019737984:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851094.421250:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.421260:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.421266:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851094.421329:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788851094.421333:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851094.421355:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.421401:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac8 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.421415:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac8 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.421423:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851094.421425:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851094.421429:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bd400, rc 0) 00000100:00100000:0.0:1788851094.421482:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+17:11293:x1875746000775040:12345-192.168.204.27@tcp:101:bash.0 Request processed in 13686us (14373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851094.421489:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:3.0:1788851094.434316:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851094.434423:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775424 00000100:00100000:2.0:1788851094.434433:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775424 00000100:00100000:2.0:1788851094.434494:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:2.0:1788851094.434504:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ec1c5d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+17:11293:x1875746000775424:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:2.0:1788851094.434756:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ec1c5d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+18:11293:x1875746000775424:12345-192.168.204.27@tcp:35:bash.0 Request processed in 252us (448us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788851094.434764:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:3.0:1788851094.540125:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851094.540227:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775680 00000100:00100000:0.0:1788851094.540238:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775680 00000100:00100000:0.0:1788851094.540305:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:0.0:1788851094.540316:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+18:11303:x1875746000775680:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851094.540343:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851094.540364:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38acf expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851094.540466:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788851094.540554:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38acf expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.540568:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea5408700) 00010000:00010000:0.0:1788851094.540571:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851094.540588:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38acf expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.540602:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc400, rc 0) 00000100:00100000:0.0:1788851094.540673:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:11303:x1875746000775680:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 358us (558us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1788851094.540680:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:3.0:1788851094.550499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851094.550606:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775808 00000100:00100000:1.0:1788851094.550627:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775808 00000100:00100000:1.0:1788851094.550700:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:1.0:1788851094.550712:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+19:11303:x1875746000775808:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:1.0:1788851094.550796:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.550832:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.550845:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.550863:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.550870:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.550876:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.550987:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551000:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551007:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851094.551098:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551111:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551117:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551135:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551142:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851094.551146:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551154:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551165:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:1.0:1788851094.551168:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851094.551173:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551180:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b205e68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551191:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551197:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551202:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551207:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851094.551210:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551223:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551230:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d81099a00) 00010000:00010000:1.0:1788851094.551233:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851094.551236:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551242:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205e6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551256:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551262:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551267:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551273:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851094.551275:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551281:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551288:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851094.551291:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851094.551293:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.551309:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205e76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851094.551679:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+19:11303:x1875746000775808:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 968us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851094.551688:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:3.0:1788851094.555045:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851094.555214:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776064 00000100:00100000:2.0:1788851094.555224:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776064 00000100:00100000:2.0:1788851094.555277:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:2.0:1788851094.555288:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:11303:x1875746000776064:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1788851094.555506:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+20:11303:x1875746000776064:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 220us (499us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788851094.555513:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:2.0:1788851094.637955:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851094.638233:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776320 00000100:00100000:0.0:1788851094.638249:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776320 00000100:00100000:0.0:1788851094.638340:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:0.0:1788851094.638353:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+20:11306:x1875746000776320:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851094.638391:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851094.638423:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ad6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638530:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638549:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638564:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638581:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638589:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638596:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638761:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205e92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638771:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638778:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851094.638788:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788851094.638876:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638884:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638891:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638896:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851094.638902:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638909:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638922:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851094.638924:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851094.638930:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.638956:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b205e84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639714:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639725:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639731:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639736:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bca00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851094.639739:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639746:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639756:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409000) 00010000:00010000:0.0:1788851094.639758:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851094.639762:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639767:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205e8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639820:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205e7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ad6 expref: 23 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639833:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ad6 expref: 22 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.639851:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851094.639854:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851094.639857:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bce00, rc 0) 00000100:00100000:0.0:1788851094.640094:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+22:11306:x1875746000776320:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1742us (2157us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788851094.640103:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:3.0:1788851094.653848:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851094.653989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851094.654765:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776576 00000100:00100000:1.0:1788851094.654778:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776576 00000100:00100000:1.0:1788851094.654846:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1788851094.654855:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+22:2409:x1875746000776576:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851094.654881:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851094.654906:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205e92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ad6 expref: 22 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.654931:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851094.654936:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851094.655049:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+21:2409:x1875746000776576:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 194us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851094.655057:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:2.0:1788851094.659678:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776448 00000100:00100000:2.0:1788851094.659696:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776448 00000100:00100000:2.0:1788851094.659820:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:2.0:1788851094.659830:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+21:11306:x1875746000776448:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:2.0:1788851094.659926:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.659957:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.659978:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.660041:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.660049:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.660070:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.660076:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851094.660081:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.660089:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.660100:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:2.0:1788851094.660103:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851094.660107:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.660113:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205ea0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851094.660195:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+21:11306:x1875746000776448:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 365us (6353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851094.660203:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:1.0:1788851094.665669:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851094.665755:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776832 00000100:00100000:2.0:1788851094.665764:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776832 00000100:00100000:2.0:1788851094.665837:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1788851094.665847:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+21:11306:x1875746000776832:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1788851094.667100:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+22:11306:x1875746000776832:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 1248us (1435us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788851094.667110:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00010000:00010000:3.0:1788851094.708314:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851094.885846:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851094.885958:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777088 00000100:00100000:3.0:1788851094.885977:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777088 00000100:00100000:3.0:1788851094.886076:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:3.0:1788851094.886087:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+22:11324:x1875746000777088:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:3.0:1788851094.886113:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851094.886147:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ea7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38add expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.886256:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205eae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.886272:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205eae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.886285:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205eae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851094.886297:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788851094.886409:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205ea7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38add expref: 25 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.886431:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205eae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38add expref: 24 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.886439:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:3.0:1788851094.886441:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788851094.886445:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031200, rc 0) 00000100:00100000:3.0:1788851094.886511:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+24:11324:x1875746000777088:12345-192.168.204.27@tcp:101:cat.0 Request processed in 426us (674us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788851094.886518:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:3.0:1788851094.933589:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851094.933707:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777216 00000100:00100000:0.0:1788851094.933718:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777216 00000100:00100000:0.0:1788851094.933781:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:0.0:1788851094.933790:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+24:11325:x1875746000777216:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851094.933816:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851094.933841:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ae4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.933959:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205ec3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.933980:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.933992:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851094.934059:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788851094.934063:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851094.934082:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.934121:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ae4 expref: 26 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.934140:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ae4 expref: 25 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.934149:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851094.934151:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851094.934155:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bca00, rc 0) 00000100:00100000:0.0:1788851094.934219:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+25:11325:x1875746000777216:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 429us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851094.934227:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:1.0:1788851094.948950:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851094.949140:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777600 00000100:00100000:2.0:1788851094.949150:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777600 00000100:00100000:2.0:1788851094.949205:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1788851094.949216:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+25:11325:x1875746000777600:12345-192.168.204.27@tcp:35:lfs.0 00000001:00080000:2.0:1788851094.949447:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967352 00000100:00100000:2.0:1788851094.949563:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+27:11325:x1875746000777600:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 348us (630us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788851094.949571:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000020:00080000:2.0:1788851094.949575:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788851094.954227:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851094.955800:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777728 00000100:00100000:2.0:1788851094.955813:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777728 00000100:00100000:2.0:1788851094.955897:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:2.0:1788851094.955908:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+27:11325:x1875746000777728:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:2.0:1788851094.955925:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788851094.956116:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205e53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ac8 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.956146:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205eae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38add expref: 26 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.956160:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205d49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a82 expref: 25 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.956169:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:2.0:1788851094.956174:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851094.957296:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+24:11325:x1875746000777728:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 1383us (3073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851094.957325:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1788851094.965710:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851094.965783:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777856 00000100:00100000:2.0:1788851094.965793:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777856 00000100:00100000:2.0:1788851094.965872:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:2.0:1788851094.965882:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+24:11325:x1875746000777856:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:2.0:1788851094.966084:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.966104:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.966116:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788851094.966355:0:10526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851094.966491:0:10526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788851094.966577:0:10526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788851094.966663:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+24:11325:x1875746000777856:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 781us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851094.966671:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:3.0:1788851094.996344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851094.996504:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777984 00000100:00100000:0.0:1788851094.996514:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777984 00000100:00100000:0.0:1788851094.996582:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:0.0:1788851094.996591:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+24:11327:x1875746000777984:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851094.996612:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851094.996632:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b205ed1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38aeb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996699:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996713:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996741:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996756:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996764:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996771:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996854:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996863:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996880:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851094.996923:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788851094.996927:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851094.996954:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996966:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996974:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996990:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.996997:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997003:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bda00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851094.997007:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997044:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997055:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851094.997059:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851094.997063:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997068:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b205ed8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997081:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997087:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997092:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997097:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851094.997107:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997112:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997119:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409000) 00010000:00010000:0.0:1788851094.997122:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851094.997125:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997130:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b205edf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997161:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b205ed1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aeb expref: 26 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997174:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aeb expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.997182:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851094.997184:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851094.997186:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bdc00, rc 0) 00000100:00100000:0.0:1788851094.997257:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+25:11327:x1875746000777984:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 667us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851094.997264:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:1.0:1788851095.283115:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.283154:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.283183:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.283216:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.283260:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.283288:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778624 00000100:00100000:1.0:1788851095.283297:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778624 00000100:00100000:1.0:1788851095.283350:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778240 00000100:00100000:1.0:1788851095.283354:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778240 00000100:00100000:1.0:1788851095.283369:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778496 00000100:00100000:1.0:1788851095.283372:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778496 00000100:00100000:1.0:1788851095.283391:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 289 00000100:00100000:1.0:1788851095.283401:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000778624:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851095.283488:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000778624:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.283496:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 289 00000100:00100000:1.0:1788851095.283515:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 290 00000100:00100000:1.0:1788851095.283522:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000778240:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851095.283547:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000778240:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.283553:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 290 00000100:00100000:1.0:1788851095.283564:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 291 00000100:00100000:1.0:1788851095.283569:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000778496:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851095.283592:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000778496:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.283598:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 291 00000100:00080000:1.0:1788851095.283631:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851095.283636:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851095.283744:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778368 00000100:00100000:1.0:1788851095.283755:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778368 00000100:00100000:1.0:1788851095.283792:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:1.0:1788851095.283798:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000778368:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851095.283829:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000778368:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.283836:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00080000:1.0:1788851095.283870:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851095.284095:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778112 00000100:00100000:3.0:1788851095.284100:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778112 00000100:00100000:3.0:1788851095.284141:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 384 00000100:00100000:3.0:1788851095.284156:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000778112:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851095.284188:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000778112:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 34us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851095.284195:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 384 00000100:00100000:2.0:1788851095.488755:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019738112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851095.488833:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851095.489823:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019738112 00000100:00100000:1.0:1788851095.489835:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019738112 00000100:00100000:1.0:1788851095.491034:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788851095.491051:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019738112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851095.491094:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788851095.491168:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019738112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.491175:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788851095.491294:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019738112:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788851095.732358:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851095.732366:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851095.732408:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788851095.732416:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788851095.732560:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e90055180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019738240:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788851095.732658:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9d540 going to sleep for 11 seconds 00010000:00010000:0.0:1788851095.733602:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851095.738780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851095.738818:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778752 00000100:00100000:3.0:1788851095.738828:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778752 00000100:00100000:3.0:1788851095.739511:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:3.0:1788851095.739523:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+26:11338:x1875746000778752:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851095.739559:0:9543:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851095.739690:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+26:11338:x1875746000778752:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 169us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851095.739698:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00080000:3.0:1788851095.739722:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851095.742577:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e90055180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019738240:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788851095.750635:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851095.750695:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778880 00000100:00100000:3.0:1788851095.750707:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778880 00000100:00100000:3.0:1788851095.751138:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:3.0:1788851095.751163:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+25:11338:x1875746000778880:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788851095.751254:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751273:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751285:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751329:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751337:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751343:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751382:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751391:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751398:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851095.751446:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788851095.751450:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851095.751467:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751477:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751488:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751494:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751499:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851095.751503:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751510:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751521:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:3.0:1788851095.751524:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851095.751528:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751534:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205eed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751544:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751549:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751553:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751557:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851095.751564:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751570:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751576:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff892ea5408500) 00010000:00010000:3.0:1788851095.751578:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851095.751581:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751586:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205ef4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751601:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751607:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751613:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751632:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851095.751635:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751641:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751648:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:3.0:1788851095.751650:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851095.751658:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.751663:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205efb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.751744:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+25:11338:x1875746000778880:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 585us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851095.753698:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:3.0:1788851095.757096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851095.757184:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779136 00000100:00100000:2.0:1788851095.757195:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779136 00000100:00100000:2.0:1788851095.757255:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:2.0:1788851095.757266:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+25:11338:x1875746000779136:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851095.757305:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851095.757327:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205f02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38af2 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757458:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757475:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757486:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851095.757497:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788851095.757578:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757586:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757592:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757597:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851095.757601:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757608:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757618:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:2.0:1788851095.757627:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851095.757633:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757639:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b205f09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757683:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205f02 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38af2 expref: 27 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757694:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:2.0:1788851095.757696:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851095.757699:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b205f02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38af2 expref: 27 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.757708:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6800, rc 0) 00000100:00100000:2.0:1788851095.757766:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+26:11338:x1875746000779136:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 500us (679us total) trans 4294967354 rc 301/301 00000100:00100000:2.0:1788851095.757773:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:0.0:1788851095.771327:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851095.771964:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779264 00000100:00100000:3.0:1788851095.771975:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779264 00000100:00100000:3.0:1788851095.772068:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:3.0:1788851095.772081:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+26:11338:x1875746000779264:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851095.772123:0:6536:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851095.772263:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+26:11338:x1875746000779264:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 185us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851095.772270:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:2.0:1788851095.783672:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851095.791301:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779520 00000100:00100000:3.0:1788851095.791319:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779520 00000100:00100000:3.0:1788851095.791436:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:3.0:1788851095.791447:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+26:11338:x1875746000779520:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851095.791468:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851095.791471:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788851095.791500:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b205ec3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ae4 expref: 26 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.791519:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:3.0:1788851095.791535:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851095.791553:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f17 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38af9 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788851095.792001:0:6535:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788851095.792168:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.792182:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.792192:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.792241:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38af9 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.792257:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38af9 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.792264:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892ea5408500) 00010000:00010000:3.0:1788851095.792266:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851095.792268:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031600, rc 0) 00000100:00100000:3.0:1788851095.792345:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+27:11338:x1875746000779520:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 900us (8688us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788851095.792353:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:3.0:1788851095.813571:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851095.813654:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779776 00000100:00100000:0.0:1788851095.813665:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779776 00000100:00100000:0.0:1788851095.813736:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:0.0:1788851095.813745:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+27:11338:x1875746000779776:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851095.813810:0:9543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851095.813835:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38af9 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.813855:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892ea5408500) 00010000:00010000:0.0:1788851095.813864:0:9543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851095.813884:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.813896:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.813905:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.813979:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.813987:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.813994:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814075:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814083:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814100:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814106:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bcc00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851095.814110:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814119:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814127:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851095.814130:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851095.814134:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814140:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b205f2c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814148:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814154:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814160:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814165:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851095.814167:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814184:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814192:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe5cc5709 (ffff892d87409400) 00010000:00010000:0.0:1788851095.814194:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851095.814197:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.814203:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b205f33 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe5cc5709 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.814287:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+26:11338:x1875746000779776:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 540us (723us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788851095.814295:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:0.0:1788851095.824845:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.824973:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779904 00000100:00100000:1.0:1788851095.824985:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779904 00000100:00100000:1.0:1788851095.825089:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:1.0:1788851095.825100:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+26:11338:x1875746000779904:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851095.825123:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851095.825149:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205f3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b00 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.825185:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.825198:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.825222:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.825330:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205f3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b00 expref: 28 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.825347:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b00 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.825355:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:1.0:1788851095.825358:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788851095.825362:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94c00, rc 0) 00000100:00100000:1.0:1788851095.825433:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+27:11338:x1875746000779904:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 335us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.825441:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:2.0:1788851095.828811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851095.828965:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000780160 00000100:00100000:3.0:1788851095.828978:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000780160 00000100:00100000:3.0:1788851095.829079:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:3.0:1788851095.829090:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+27:11338:x1875746000780160:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851095.829193:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.829215:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.829231:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851095.829416:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788851095.829426:0:6535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429888412722ns, next at 430888409732ns, rc = 0 00000004:00010000:3.0:1788851095.829477:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000caa49c0a reply state 00000000fc2d6c20 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.829490:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.829497:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:3.0:1788851095.829500:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788851095.829505:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851095.829606:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+29:11338:x1875746000780160:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 518us (805us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788851095.829614:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:3.0:1788851095.833261:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.833355:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000780288 00000100:00100000:1.0:1788851095.833364:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000780288 00000100:00100000:1.0:1788851095.833406:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:1.0:1788851095.833414:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+29:11338:x1875746000780288:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851095.833439:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851095.833460:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b07 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.833513:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b07 expref: 30 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.833527:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b07 expref: 30 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.833557:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:1.0:1788851095.833560:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851095.833564:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94200, rc 0) 00000100:00100000:1.0:1788851095.834152:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+30:11338:x1875746000780288:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 202us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.834165:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:0.0:1788851095.842880:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.843050:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000780416 00000100:00100000:1.0:1788851095.843061:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000780416 00000100:00100000:2.0:1788851095.843232:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1788851095.843241:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1875746000780416:12345-192.168.204.27@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788851095.843276:0:8447:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:2.0:1788851095.843333:0:8447:0:(genops.c:1384:class_connect()) connect: client a99889d1-fa00-4984-a18e-0736ff414641, cookie 0x3e0030720b205f56 00002000:00100000:2.0:1788851095.843345:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a99889d1-fa00-4984-a18e-0736ff414641/ffff892d882f8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851095.843364:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788851095.843446:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788851095.843476:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892d882fe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851095.843548:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2406:x1875746000780416:12345-192.168.204.27@tcp:8:lhsmtool_posix.0 Request processed in 305us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851095.843555:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:3.0:1788851095.863952:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.864069:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000780544 00000100:00100000:1.0:1788851095.864081:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000780544 00000100:00100000:1.0:1788851095.864156:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:1.0:1788851095.864168:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:0:x1875746000780544:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788851095.864557:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788851095.867828:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1788851095.867843:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000100:00100000:1.0:1788851095.868119:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:0:x1875746000780544:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 3947us (4179us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788851095.868130:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1788851095.875776:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.875883:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000780800 00000100:00100000:1.0:1788851095.875892:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000780800 00000100:00100000:1.0:1788851095.875967:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788851095.875977:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+30:11338:x1875746000780800:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788851095.876243:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+31:11338:x1875746000780800:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 267us (478us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788851095.876252:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:3.0:1788851095.878850:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.879441:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781056 00000100:00100000:1.0:1788851095.879455:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781056 00000100:00100000:1.0:1788851095.879525:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:1.0:1788851095.879542:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+31:11338:x1875746000781056:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788851095.879660:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+31:11338:x1875746000781056:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 109us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.879667:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:3.0:1788851095.884897:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.884972:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781184 00000100:00100000:1.0:1788851095.884982:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781184 00000100:00100000:1.0:1788851095.885065:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:1.0:1788851095.885077:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+31:11338:x1875746000781184:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851095.885098:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851095.885118:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205f5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b0e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.885201:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205f64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.885219:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205f64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.885233:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205f64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851095.885289:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851095.885311:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205f64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.885339:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b205f5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b0e expref: 33 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.885358:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205f64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b0e expref: 32 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.885381:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:1.0:1788851095.885384:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788851095.885388:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94000, rc 0) 00000100:00100000:1.0:1788851095.885453:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+32:11338:x1875746000781184:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 378us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.885460:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:0.0:1788851095.893422:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851095.893501:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781312 00000100:00100000:1.0:1788851095.893511:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781312 00000100:00100000:1.0:1788851095.893571:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:1.0:1788851095.893581:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000781312:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851095.893599:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851095.893620:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b15 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851095.893648:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb397, blocks: 0x0 00010000:00010000:1.0:1788851095.893669:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=429s v=(0 0) 00010000:00010000:1.0:1788851095.893673:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851095.893684:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b15 expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.893702:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b15 expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.893717:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95e00, rc 0) 00000100:00100000:1.0:1788851095.893783:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000781312:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 202us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.893789:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:0.0:1788851095.902195:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851095.902236:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781568 00000100:00100000:0.0:1788851095.902246:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781568 00000100:00100000:0.0:1788851095.902301:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:0.0:1788851095.902311:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+32:11338:x1875746000781568:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788851095.902434:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+32:11338:x1875746000781568:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 124us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851095.902442:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:3.0:1788851095.911194:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851095.911308:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781696 00000100:00100000:0.0:1788851095.911320:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781696 00000100:00100000:0.0:1788851095.911385:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1788851095.911396:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:11338:x1875746000781696:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851095.911417:0:8625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851095.911439:0:8625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b1c expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.911471:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b15 expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.911480:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851095.911486:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851095.911490:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.911526:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b15 expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.911539:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b15 expref: 7 pid: 8447 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.911553:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1875746019738368:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851095.911641:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851095.914344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851095.918942:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781824 00000100:00100000:0.0:1788851095.918958:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781824 00010000:00010000:0.0:1788851095.919009:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b15 expref: 8 pid: 8447 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.919086:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1788851095.919096:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000781824:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851095.919112:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851095.919133:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b15 expref: 8 pid: 8447 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.919146:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b15 expref: 8 pid: 8447 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.919173:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851095.919177:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851095.919185:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.919196:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.919238:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.919251:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6519:1875746019738496:192.168.204.27@tcp:105: 00000100:00100000:0.0:1788851095.919328:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788851095.919502:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b205f6b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b15 expref: 8 pid: 8447 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.919526:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1875746019738368:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851095.919550:0:8625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.919561:0:8625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bcc00, rc 0) 00000100:00100000:0.0:1788851095.919597:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:11338:x1875746000781696:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 8202us (8411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851095.919604:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:1.0:1788851095.929541:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851095.929771:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781952 00000100:00100000:3.0:1788851095.929782:0:8455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781952 00002000:00100000:3.0:1788851095.929834:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff892e87079180 x1875746000781952/t0(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:161/0 lens 504/0 e 0 to 0 dl 1788851106 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851095.929856:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892e87079180 with x1875746000781952 ext(0->8) 00002000:00010000:3.0:1788851095.929862:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892e87079180 00000100:00100000:3.0:1788851095.929899:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1788851095.929910:0:8455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000781952:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788851095.931465:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6519:1875746019738496:192.168.204.27@tcp:105: 00010000:00010000:2.0:1788851095.931489:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851095.931542:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+9:2408:x1875746000781824:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 12448us (17208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851095.931551:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1788851095.931670:0:8455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000781952:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 1761us (2139us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788851095.931678:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00002000:00100000:3.0:1788851095.931686:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff892e87079180 x1875746000781952/t4294967303(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:161/0 lens 504/448 e 0 to 0 dl 1788851106 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851095.931696:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892e87079180 with x1875746000781952 ext(0->8) 00002000:00010000:3.0:1788851095.931700:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892e87079180 00000100:00100000:0.0:1788851095.939711:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851095.939785:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782080 00000100:00100000:3.0:1788851095.939796:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782080 00000100:00100000:3.0:1788851095.939864:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 90 00000100:00100000:3.0:1788851095.939875:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+32:11338:x1875746000782080:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788851095.942412:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:1.0:1788851095.942431:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788851095.942469:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1788851095.942569:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851095.942587:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019738624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788851095.942653:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851095.942699:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019738624 00000100:00100000:1.0:1788851095.942705:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019738624 00000100:00100000:1.0:1788851095.942757:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788851095.942765:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019738624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788851095.942902:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788851095.942905:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788851095 00002000:00010000:1.0:1788851095.942908:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788851095.942910:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788851095 -> 1788851095 00002000:00010000:1.0:1788851095.942912:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788851095.943123:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019738624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 357us (469us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788851095.943131:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788851095.943152:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788851095.943179:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892e87078e00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788851095.943185:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019738624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788851095.943290:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+16:11338:x1875746000782080:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 3415us (3585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.943317:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 90 00010000:00010000:0.0:1788851095.943843:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943868:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943876:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943881:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851095.943886:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943893:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943912:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851095.943924:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851095.943940:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943956:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205e45 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943977:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943984:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943989:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.943993:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851095.943996:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.944001:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.944008:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:0.0:1788851095.944134:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788851095.944138:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.944145:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b205f48 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788851095.944164:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788851095.944174:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788851095.953724:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851095.955567:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782208 00000100:00100000:3.0:1788851095.955580:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782208 00000100:00100000:3.0:1788851095.955646:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:3.0:1788851095.955664:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+8:2410:x1875746000782208:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788851095.963380:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1788851095.963396:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1788851095.963571:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000782208:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 7904us (9852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851095.963582:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1788851095.979664:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851095.979796:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782464 00000100:00100000:3.0:1788851095.979807:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782464 00000100:00100000:3.0:1788851095.979879:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:3.0:1788851095.979892:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+14:11338:x1875746000782464:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851095.979965:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851095.979993:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b205f64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b0e expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.980200:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:3.0:1788851095.980208:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851095.980244:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.980258:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.980268:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851095.980404:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9683214 reply state 0000000082340e11 transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.980417:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.980423:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:3.0:1788851095.980437:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851095.980440:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851095.980539:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+15:11338:x1875746000782464:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 651us (900us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1788851095.980547:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:3.0:1788851095.986066:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851095.986288:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782592 00000100:00100000:2.0:1788851095.986297:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782592 00000100:00100000:2.0:1788851095.986351:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:2.0:1788851095.986361:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000782592:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788851095.986528:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788851095.986532:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788851095 -> 1788851094 00002000:00010000:2.0:1788851095.986534:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788851091 00002000:00010000:2.0:1788851095.986536:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788851095 -> 1788851094 00002000:00010000:2.0:1788851095.986538:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788851095.986604:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000782592:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 244us (547us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788851095.986612:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:3.0:1788851095.989047:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851095.989180:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782848 00000100:00100000:0.0:1788851095.989206:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782848 00000100:00100000:0.0:1788851095.989268:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:0.0:1788851095.989279:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+15:11338:x1875746000782848:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788851095.989356:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.989375:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b00 expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.989386:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.989422:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b00 expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.989435:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b00 expref: 15 pid: 6534 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.989449:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d86a9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019738752:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851095.989532:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851095.991537:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d86a9bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019738752:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851095.991565:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.997236:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851096.006985:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782976 00000100:00100000:2.0:1788851096.007021:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782976 00010000:00010000:2.0:1788851096.007067:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b00 expref: 16 pid: 6534 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851096.007172:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1788851096.007191:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+16:2407:x1875746000782976:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851096.007318:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851096.007328:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b00 expref: 16 pid: 6534 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007343:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b00 expref: 16 pid: 6534 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007366:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205f41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b00 expref: 16 pid: 6534 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007384:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:2.0:1788851096.007390:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007401:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007410:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007442:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851096.007574:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+15:2407:x1875746000782976:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 392us (10346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851096.007591:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00010000:00010000:2.0:1788851096.007624:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007632:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007678:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007686:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007693:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007699:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851096.007703:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007711:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007721:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:2.0:1788851096.007724:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788851096.007728:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.007734:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b205f80 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851096.007893:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+14:11338:x1875746000782848:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 18615us (18884us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788851096.007908:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:3.0:1788851096.013792:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851096.013880:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783104 00000100:00100000:1.0:1788851096.013892:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783104 00000100:00100000:1.0:1788851096.013969:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:1.0:1788851096.013980:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000783104:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788851096.014057:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.014081:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.014090:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788851096.014095:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851096.014100:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.014136:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.014150:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 7 pid: 8625 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851096.014165:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1875746019738880:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851096.014248:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64540 going to sleep for 11 seconds 00000100:00100000:0.0:1788851096.020693:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1875746019738880:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851096.020728:0:8625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851096.023297:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851096.023496:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783232 00000100:00100000:0.0:1788851096.023509:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783232 00010000:00010000:0.0:1788851096.023557:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 8 pid: 8625 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851096.023600:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:0.0:1788851096.023609:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000783232:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851096.023624:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851096.023738:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 8 pid: 8625 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.023754:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 8 pid: 8625 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.023781:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053f5bbcf/0x3e0030720b205f72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b1c expref: 8 pid: 8625 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.023798:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851096.023802:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851096.023808:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.023818:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.023881:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851096.023947:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000783232:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 338us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851096.023954:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00010000:00010000:3.0:1788851096.024335:0:8625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.024345:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.024367:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.024375:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.024383:0:8625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.024390:0:8625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851096.024394:0:8625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.024411:0:8625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.024427:0:8625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.024435:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b205f87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851096.024501:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000783104:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 10524us (10718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851096.024510:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:0.0:1788851096.040461:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851096.040534:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783488 00000100:00100000:3.0:1788851096.040544:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783488 00000100:00100000:3.0:1788851096.040605:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 93 00000100:00100000:3.0:1788851096.040616:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+14:11338:x1875746000783488:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788851096.040701:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.040720:0:9543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aa5 expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.040729:0:9543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.040767:0:9543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aa5 expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.040789:0:9543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aa5 expref: 14 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851096.040803:0:9543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88286d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019739008:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851096.041072:0:9543:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90913e40 going to sleep for 11 seconds 00000040:00080000:1.0:1788851096.052495:0:14227:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851096.052506:0:14227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851096.052532:0:14227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788851096.052538:0:14227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788851096.053731:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851096.053738:0:9543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88286d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019739008:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851096.053770:0:9543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851096.053800:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783616 00000100:00100000:2.0:1788851096.053807:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783616 00010000:00010000:2.0:1788851096.053839:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aa5 expref: 15 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851096.053882:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:2.0:1788851096.053891:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+15:2407:x1875746000783616:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851096.053906:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851096.053923:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aa5 expref: 15 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.053936:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aa5 expref: 15 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.053962:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205dce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aa5 expref: 15 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.053978:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:2.0:1788851096.053982:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.053991:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.054007:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.054055:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851096.054105:0:9543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.054114:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.054301:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.054313:0:9543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b07 expref: 15 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.054321:0:9543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.054357:0:9543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b07 expref: 15 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.054370:0:9543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b07 expref: 15 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851096.054385:0:9543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019739136:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851096.054453:0:9543:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788851096.054576:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+15:2407:x1875746000783616:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 684us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851096.054584:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:0.0:1788851096.057354:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851096.057461:0:9543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019739136:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851096.058108:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783744 00000100:00100000:0.0:1788851096.058116:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783744 00010000:00010000:0.0:1788851096.058156:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b07 expref: 15 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851096.058187:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:0.0:1788851096.058195:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+15:2408:x1875746000783744:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851096.058209:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851096.058215:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b07 expref: 15 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.058226:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b07 expref: 15 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.058247:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b205f4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b07 expref: 15 pid: 6536 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.058261:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:0.0:1788851096.058266:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.058275:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.058282:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.058314:0:9543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.058319:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851096.058329:0:9543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.058336:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851096.058370:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+14:2408:x1875746000783744:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 174us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851096.058377:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000001:00080000:2.0:1788851096.058447:0:9543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788851096.058641:0:9543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:2.0:1788851096.058679:0:9543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788851096.058762:0:9543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9543:1875746019739264:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788851096.058810:0:9543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851096.058844:0:9543:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab540 going to sleep for 11 seconds 00000100:00100000:1.0:1788851096.059541:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019739264 00000100:00100000:1.0:1788851096.059549:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019739264 00000100:00100000:1.0:1788851096.059594:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788851096.059603:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9543:x1875746019739264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788851096.059803:0:9543:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788851096.059810:0:9543:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892e87078e00, transno 4294967304 00000100:00100000:2.0:1788851096.059825:0:9543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9543:1875746019739264:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788851096.059936:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9543:x1875746019739264:12345-0@lo:1000:mdt00_003.0 Request processed in 334us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.059954:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000001:00080000:2.0:1788851096.059988:0:9543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:2.0:1788851096.060065:0:9543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9543:1875746019739392:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788851096.060122:0:9543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851096.060146:0:9543:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851096.060165:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019739392 00000100:00100000:2.0:1788851096.060170:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019739392 00000100:00100000:2.0:1788851096.062676:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788851096.062694:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9543:x1875746019739392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788851096.062882:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9543:x1875746019739392:12345-0@lo:1000:mdt00_003.0 Request processed in 195us (2759us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788851096.062890:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788851096.062964:0:9543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9543:1875746019739392:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788851096.063027:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063038:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063045:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063050:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851096.063055:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063062:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063076:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:2.0:1788851096.063079:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851096.063085:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063102:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b205f95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063133:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063140:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063147:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063152:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851096.063155:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063162:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063171:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:2.0:1788851096.063173:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851096.063176:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063182:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b205eca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063220:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063236:0:9543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aeb expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063251:0:9543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063281:0:9543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aeb expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.063296:0:9543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aeb expref: 17 pid: 6535 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851096.063310:0:9543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019739520:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851096.063395:0:9543:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851096.092531:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851096.092605:0:9543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019739520:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851096.092638:0:9543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851096.094218:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783872 00000100:00100000:1.0:1788851096.094233:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783872 00010000:00010000:1.0:1788851096.094292:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aeb expref: 18 pid: 6535 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851096.094334:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1788851096.094344:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+18:2407:x1875746000783872:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851096.094359:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851096.094366:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aeb expref: 18 pid: 6535 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.094381:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aeb expref: 18 pid: 6535 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.094405:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b205ee6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38aeb expref: 18 pid: 6535 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.094444:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:1.0:1788851096.094450:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.094460:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.094467:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.094496:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851096.094572:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+17:2407:x1875746000783872:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 227us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.094581:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00010000:00010000:0.0:1788851096.102155:0:9543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102174:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102200:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102209:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102216:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102223:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851096.102228:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102235:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102253:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851096.102256:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851096.102261:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102273:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b205f9c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102287:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102292:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102298:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102302:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851096.102305:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102311:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102319:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d81099b00) 00010000:00010000:0.0:1788851096.102321:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851096.102324:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.102329:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205f8e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851096.102544:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:0.0:1788851096.102547:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+16:11338:x1875746000783488:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 61928us (62090us total) trans 4294967363 rc 0/0 00000040:00080000:1.0:1788851096.102550:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788851096.102563:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 93 00000040:00080000:1.0:1788851096.102571:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000020:00080000:0.0:1788851096.102576:0:9543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788851096.102580:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788851096.107500:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851096.107529:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784128 00000100:00100000:1.0:1788851096.107541:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784128 00000100:00100000:1.0:1788851096.107603:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1788851096.107614:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+16:11338:x1875746000784128:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788851096.107910:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788851096.107962:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:1.0:1788851096.107996:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.108032:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.108058:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.108067:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.108074:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.108081:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.108098:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788851096.108176:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+18:11338:x1875746000784128:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 564us (683us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788851096.108185:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000020:00080000:1.0:1788851096.108190:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788851096.110619:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851096.110633:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.110645:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851096.110668:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.110679:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.110702:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:3.0:1788851096.110706:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788851096.110713:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.110721:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b205fa3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.110738:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851096.110740:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851096.110742:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851096.757544:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851097.525904:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019739648:0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.525988:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851097.526071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019740160:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526095:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019739648 00000100:00100000:1.0:1788851097.526098:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526103:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019739648 00000100:00100000:1.0:1788851097.526117:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019740672:0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526137:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851097.526154:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019741184:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526173:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788851097.526173:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526182:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019739648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526192:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788851097.526197:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019740032:0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526224:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526229:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019739648:12345-0@lo:400:kworker.0 Request processed in 49us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.526236:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788851097.526239:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019740544:0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526256:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851097.526271:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019741056:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526287:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019740672 00000100:00100000:1.0:1788851097.526289:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526303:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019740672 00000100:00100000:1.0:1788851097.526316:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019739648:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526331:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019741184 00000100:00100000:3.0:1788851097.526334:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019741184 00000100:00100000:1.0:1788851097.526343:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019739776:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526348:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019740544 00000100:00100000:3.0:1788851097.526350:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019740544 00000100:00100000:3.0:1788851097.526361:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019741056 00000100:00100000:3.0:1788851097.526363:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019741056 00000100:00100000:1.0:1788851097.526365:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526375:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788851097.526380:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019740288:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526381:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019740672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526399:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526412:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019740672:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.526414:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019740800:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526418:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788851097.526429:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788851097.526432:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526434:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019741184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526447:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019741312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851097.526458:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019741184:12345-0@lo:400:kworker.0 Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.526464:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788851097.526465:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526475:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788851097.526480:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019740544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526481:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788851097.526486:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019739904:0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526504:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526517:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019740544:12345-0@lo:400:kworker.0 Request processed in 37us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.526519:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019740416:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526531:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788851097.526536:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526542:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788851097.526548:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019741056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526557:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019740928:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526573:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019741056:12345-0@lo:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.526573:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.526579:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788851097.526593:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019740160 00000100:00080000:3.0:1788851097.526594:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851097.526596:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019740160 00000100:00080000:3.0:1788851097.526598:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851097.526605:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019740032 00000100:00100000:3.0:1788851097.526608:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019740032 00000100:00100000:1.0:1788851097.526619:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019739904 00000100:00100000:3.0:1788851097.526624:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019739776 00000100:00100000:3.0:1788851097.526626:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019739776 00000100:00100000:1.0:1788851097.526626:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019739904 00000100:00100000:3.0:1788851097.526634:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019740288 00000100:00100000:3.0:1788851097.526636:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019740288 00000100:00100000:1.0:1788851097.526639:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788851097.526644:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019740160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526650:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019740800 00000100:00100000:3.0:1788851097.526652:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019740800 00000100:00100000:3.0:1788851097.526661:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019740416 00000100:00100000:3.0:1788851097.526663:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019740416 00000100:00100000:3.0:1788851097.526674:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019740928 00000100:00100000:1.0:1788851097.526675:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019740160:12345-0@lo:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.526676:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019740928 00000100:00100000:1.0:1788851097.526681:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788851097.526688:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788851097.526693:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019740032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526693:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788851097.526697:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019739904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526719:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019740032:12345-0@lo:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.526720:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019739904:12345-0@lo:400:kworker.0 Request processed in 23us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.526725:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788851097.526726:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788851097.526736:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788851097.526742:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019739776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526750:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788851097.526756:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019740288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526766:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019739776:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.526778:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788851097.526779:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019740288:12345-0@lo:400:kworker.0 Request processed in 23us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.526784:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788851097.526789:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788851097.526793:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788851097.526795:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019740800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.526798:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019740416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.526818:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019740800:12345-0@lo:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.526818:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019740416:12345-0@lo:400:kworker.0 Request processed in 19us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.526823:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788851097.529039:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788851097.529234:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788851097.529252:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019740928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.529342:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019740928:12345-0@lo:400:kworker.0 Request processed in 100us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.529367:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788851097.529408:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019741312 00000100:00100000:1.0:1788851097.529416:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019741312 00000100:00100000:1.0:1788851097.529462:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788851097.529469:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019741312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851097.529491:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788851097.529527:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019741312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.529532:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788851097.529589:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019739904:0@lo:400:kworker.0 00010000:00080000:1.0:1788851097.529608:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5992a00 x1875746019740416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851097.529619:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019740416:0@lo:400:kworker.0 00010000:00080000:1.0:1788851097.529630:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5993800 x1875746019740928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851097.529639:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019740928:0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.529651:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019739776:0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.529663:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019740288:0@lo:400:kworker.0 00000100:00100000:1.0:1788851097.529673:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019740800:0@lo:400:kworker.0 00000100:00080000:3.0:1788851097.530438:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788851097.530445:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851097.530482:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019740032:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.530496:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019740544:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.530506:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019741056:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.530517:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019740160:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.530528:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019740672:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.530540:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019741184:0@lo:400:kworker.0 00000100:00100000:3.0:1788851097.530571:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851097.530581:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019741568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851097.530626:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.530666:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019741568 00000100:00100000:3.0:1788851097.530671:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019741568 00000100:00100000:3.0:1788851097.530704:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788851097.530711:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019741568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788851097.530730:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851097.531371:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019741440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851097.531410:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851097.531497:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019741312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851097.531539:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019741440 00000100:00100000:1.0:1788851097.531544:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019741440 00000100:00100000:1.0:1788851097.531579:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788851097.531586:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019741440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851097.531598:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788851097.531649:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019741440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.531655:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788851097.531674:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851097.531682:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019741696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851097.532224:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019741568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1511us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.532240:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788851097.532291:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019741568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851097.532986:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019741440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851097.534154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851097.534284:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019741696 00000100:00100000:0.0:1788851097.534293:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019741696 00000100:00100000:0.0:1788851097.534350:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788851097.534361:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875746019741696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851097.534389:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851097.534451:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875746019741696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851097.534458:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788851097.534500:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019741696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788851097.781332:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851097.873760:0:14278:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788851097.873771:0:14278:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788851097.873808:0:14278:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788851097.873817:0:14278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788851098.049804:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.049947:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784384 00000100:00100000:3.0:1788851098.049960:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784384 00000100:00100000:3.0:1788851098.050054:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:3.0:1788851098.050065:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+18:11357:x1875746000784384:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851098.050090:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851098.050122:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205faa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b23 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.050239:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205fb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.050255:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.050269:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851098.050282:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788851098.050628:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b205faa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b23 expref: 21 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.050648:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b23 expref: 20 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.050658:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:3.0:1788851098.050672:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851098.050676:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031600, rc 0) 00000100:00100000:3.0:1788851098.050744:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+20:11357:x1875746000784384:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 681us (952us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788851098.050752:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00080000:2.0:1788851098.051080:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788851098.051510:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1788851098.051524:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1788851098.053116:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851098.053253:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784512 00000100:00100000:0.0:1788851098.053262:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784512 00000100:00100000:0.0:1788851098.053334:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:0.0:1788851098.053345:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+20:11357:x1875746000784512:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:0.0:1788851098.053419:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053439:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053452:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053480:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053488:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053495:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053566:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053575:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053581:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851098.053626:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053639:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053646:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053653:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053660:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bce00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.053664:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053678:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053689:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851098.053692:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.053696:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053702:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b205fbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053715:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053721:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053727:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053732:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.053735:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053741:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053747:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409000) 00010000:00010000:0.0:1788851098.053749:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.053752:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053766:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b205fc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053780:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053786:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053791:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053796:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.053799:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053806:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053813:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851098.053815:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.053817:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.053823:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b205fcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.053918:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+20:11357:x1875746000784512:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 574us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.053927:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:3.0:1788851098.109896:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851098.110079:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784768 00000100:00100000:2.0:1788851098.110090:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784768 00000100:00100000:2.0:1788851098.110158:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:2.0:1788851098.110171:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+20:11360:x1875746000784768:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851098.110190:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851098.110220:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205fd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b2a expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110320:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110336:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110349:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110365:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110371:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110376:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110494:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110503:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110510:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851098.110519:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788851098.110594:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110612:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110619:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110626:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851098.110630:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110639:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110651:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:2.0:1788851098.110654:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851098.110659:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110665:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b205fdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110678:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110685:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110692:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110698:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851098.110707:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110714:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110722:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8a8cbf00) 00010000:00010000:2.0:1788851098.110725:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851098.110728:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110735:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b205fe2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110778:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b205fd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b2a expref: 23 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110792:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b2a expref: 22 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.110799:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:2.0:1788851098.110801:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851098.110804:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6000, rc 0) 00000100:00100000:2.0:1788851098.110872:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+22:11360:x1875746000784768:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 703us (995us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788851098.110890:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:2.0:1788851098.119472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.119531:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784896 00000100:00100000:3.0:1788851098.119540:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784896 00000100:00100000:3.0:1788851098.122405:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:3.0:1788851098.122424:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+22:11360:x1875746000784896:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1788851098.122495:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.122512:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.122525:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.122564:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.122571:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.122579:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.122585:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851098.122603:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.122611:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.122622:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851098.122625:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851098.122630:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.122637:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ff7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.122727:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+22:11360:x1875746000784896:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 309us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851098.122736:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:1.0:1788851098.131820:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851098.131902:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785152 00000100:00100000:2.0:1788851098.131913:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785152 00000100:00100000:2.0:1788851098.131981:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1788851098.132004:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ec1c5d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+22:11360:x1875746000785152:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1788851098.132274:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ec1c5d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+23:11360:x1875746000785152:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 271us (463us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788851098.132283:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1788851098.170720:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.170821:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785408 00000100:00100000:3.0:1788851098.170834:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785408 00000100:00100000:3.0:1788851098.170918:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:3.0:1788851098.170930:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+23:10877:x1875746000785408:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851098.170958:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851098.170980:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ffe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b31 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.171136:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.171152:0:10526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b2a expref: 24 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.171183:0:10526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.171223:0:10526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b2a expref: 24 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.171237:0:10526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b2a expref: 24 pid: 9543 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.171253:0:10526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019741824:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851098.171408:0:10526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788851098.178570:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851098.178679:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785536 00000100:00100000:0.0:1788851098.178688:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785536 00010000:00010000:0.0:1788851098.178729:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b2a expref: 25 pid: 9543 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.178777:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:0.0:1788851098.178787:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+25:2408:x1875746000785536:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851098.178802:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851098.178821:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b2a expref: 25 pid: 9543 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.178835:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b2a expref: 25 pid: 9543 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.178854:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:0.0:1788851098.178860:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.178870:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.178888:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.178916:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851098.178975:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+25:2408:x1875746000785536:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 188us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.178983:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00010000:00010000:3.0:1788851098.182402:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b205fe9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b2a expref: 24 pid: 9543 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.182431:0:10526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019741824:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851098.182456:0:10526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.182466:0:10526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.182472:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851098.182494:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788851098.182639:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b205ffe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b31 expref: 25 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.182677:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b31 expref: 24 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.182686:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851098.182689:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851098.182692:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031200, rc 0) 00000100:00100000:3.0:1788851098.182766:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+24:10877:x1875746000785408:12345-192.168.204.27@tcp:101:bash.0 Request processed in 11837us (12058us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788851098.182775:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:1.0:1788851098.190691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851098.190817:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785664 00000100:00100000:2.0:1788851098.190828:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785664 00000100:00100000:2.0:1788851098.190911:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:2.0:1788851098.190921:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+24:10877:x1875746000785664:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1788851098.190948:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851098.190972:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206013 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b38 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.191269:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20601a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.191287:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20601a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.191312:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20601a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.191435:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206013 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b38 expref: 26 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.191455:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20601a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b38 expref: 25 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.191465:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:2.0:1788851098.191476:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788851098.191480:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6200, rc 0) 00000100:00100000:2.0:1788851098.191589:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+25:10877:x1875746000785664:12345-192.168.204.27@tcp:101:bash.0 Request processed in 667us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.191596:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:1.0:1788851098.198515:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.198616:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785920 00000100:00100000:3.0:1788851098.198627:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785920 00000100:00100000:3.0:1788851098.198695:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:3.0:1788851098.198707:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+25:10877:x1875746000785920:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:3.0:1788851098.199132:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.199150:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.199163:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851098.199213:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:3.0:1788851098.199239:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec7c1373 reply state 00000000286923cc transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.199252:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.199274:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851098.199277:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851098.199282:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788851098.206274:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:2.0:1788851098.206546:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+29:10877:x1875746000785920:12345-192.168.204.27@tcp:36:bash.0 Request processed in 7835us (8039us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788851098.206557:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 100 00000020:00080000:2.0:1788851098.206564:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788851098.214114:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.214203:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786048 00000100:00100000:3.0:1788851098.214212:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786048 00000100:00100000:3.0:1788851098.214276:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:3.0:1788851098.214287:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+29:10877:x1875746000786048:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851098.214312:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851098.214331:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206028 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b3f expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.214392:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206028 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b3f expref: 30 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.214406:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206028 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b3f expref: 30 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.214424:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851098.214427:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851098.214430:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030c00, rc 0) 00000100:00100000:3.0:1788851098.214583:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+30:10877:x1875746000786048:12345-192.168.204.27@tcp:101:bash.0 Request processed in 297us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851098.214589:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:1.0:1788851098.218685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.218774:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786176 00000100:00100000:3.0:1788851098.218784:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786176 00000100:00100000:3.0:1788851098.218884:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:3.0:1788851098.218896:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:10877:x1875746000786176:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851098.218942:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851098.218965:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b46 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851098.218991:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fb396, atime: 0x6a9fb393, ctime: 0x6a9fb396, blocks: 0x8 00010000:00010000:3.0:1788851098.219035:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1788851098.219041:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851098.219050:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b46 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.219069:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b46 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.219082:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d600, rc 0) 00000100:00100000:3.0:1788851098.219141:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:10877:x1875746000786176:12345-192.168.204.27@tcp:101:bash.0 Request processed in 247us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851098.219148:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00080000:2.0:1788851098.221943:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851098.222572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851098.222656:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786304 00000100:00100000:2.0:1788851098.222666:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786304 00002000:00010000:2.0:1788851098.222711:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788851098.222715:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892e87078e00 with x1875746000786304 ext(0->18446744073709551615) 00002000:00010000:2.0:1788851098.222732:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892e87078e00. 00000100:00100000:2.0:1788851098.222765:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:2.0:1788851098.222776:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000786304:12345-192.168.204.27@tcp:10:bash.0 00002000:00010000:2.0:1788851098.223348:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788851098.223352:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788851094 -> 1788851097 00002000:00010000:2.0:1788851098.223355:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788851091 -> 1788851091 00002000:00010000:2.0:1788851098.223357:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788851094 -> 1788851097 00002000:00010000:2.0:1788851098.223359:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788851098.223424:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000786304:12345-192.168.204.27@tcp:10:bash.0 Request processed in 649us (856us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788851098.223431:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00002000:00010000:2.0:1788851098.223435:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788851098.223449:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892e87078e00 with x1875746000786304 ext(0->18446744073709551615) 00002000:00010000:2.0:1788851098.223455:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892e87078e00. 00000100:00100000:1.0:1788851098.315718:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851098.315835:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786432 00000100:00100000:2.0:1788851098.315848:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786432 00000100:00100000:2.0:1788851098.315934:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:2.0:1788851098.315945:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+30:11374:x1875746000786432:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:1.0:1788851098.316299:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316317:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316328:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316344:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316364:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316371:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316445:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316454:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316461:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851098.316500:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316511:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316518:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316524:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316530:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851098.316534:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316542:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316558:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:1.0:1788851098.316561:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851098.316566:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316573:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206036 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316585:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316591:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316597:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316602:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851098.316605:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316611:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316617:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8dc9b300) 00010000:00010000:1.0:1788851098.316619:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851098.316621:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316627:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20603d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316648:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316654:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316660:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316664:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851098.316667:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316672:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316677:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:1.0:1788851098.316679:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851098.316682:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.316687:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206044 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.316758:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+30:11374:x1875746000786432:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 814us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.316766:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:1.0:1788851098.360370:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851098.360586:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786688 00000100:00100000:2.0:1788851098.360596:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786688 00000100:00100000:2.0:1788851098.360668:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:2.0:1788851098.360677:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+30:11377:x1875746000786688:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851098.360698:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851098.360721:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20604b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b4d expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.360817:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.360832:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.360843:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.360857:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.360864:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.360883:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361297:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206060 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361308:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361315:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851098.361324:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788851098.361406:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361414:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361420:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361425:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851098.361430:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361437:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361449:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:2.0:1788851098.361452:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851098.361457:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361474:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206052 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361488:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361494:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361501:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361506:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851098.361509:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361515:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361523:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8a8cbf00) 00010000:00010000:2.0:1788851098.361525:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851098.361527:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361533:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206059 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361578:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20604b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b4d expref: 33 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361591:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206060 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b4d expref: 32 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.361606:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:2.0:1788851098.361608:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788851098.361610:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6600, rc 0) 00000100:00100000:2.0:1788851098.362095:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+32:11377:x1875746000786688:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1416us (1733us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788851098.362103:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:2.0:1788851098.367616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.367688:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786816 00000100:00100000:3.0:1788851098.367697:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786816 00000100:00100000:3.0:1788851098.367754:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 104 00000100:00100000:3.0:1788851098.367763:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+32:11377:x1875746000786816:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1788851098.367865:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.367891:0:10526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b31 expref: 32 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.367924:0:10526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.367964:0:10526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b31 expref: 32 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.367978:0:10526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b31 expref: 32 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.367991:0:10526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019741952:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851098.368306:0:10526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788851098.377334:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.377494:0:10526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019741952:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851098.377526:0:10526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.377614:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787072 00000100:00100000:2.0:1788851098.377622:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787072 00000100:00100000:2.0:1788851098.377680:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1788851098.377690:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+33:6189:x1875746000787072:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788851098.378044:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+34:6189:x1875746000787072:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 354us (721us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788851098.378052:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1788851098.381222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851098.381324:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787200 00000100:00100000:1.0:1788851098.381351:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787200 00010000:00010000:1.0:1788851098.381390:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b31 expref: 34 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.381434:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:1.0:1788851098.381444:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+34:2407:x1875746000787200:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851098.381458:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851098.381464:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b31 expref: 34 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.381477:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b31 expref: 34 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.381497:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206005 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b31 expref: 34 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.381515:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:1.0:1788851098.381520:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.381531:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.381538:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.381682:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851098.381744:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+33:2407:x1875746000787200:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 301us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.381762:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00010000:00010000:3.0:1788851098.383878:0:10526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.383953:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.384179:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.384187:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.384434:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.384440:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8a00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851098.384444:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.384473:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.384491:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:2.0:1788851098.384494:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851098.384500:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.384506:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b20606e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.384642:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+32:11377:x1875746000786816:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 16876us (17031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.384665:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 104 00000100:00100000:2.0:1788851098.393742:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851098.393968:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787456 00000100:00100000:1.0:1788851098.393979:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787456 00000100:00100000:1.0:1788851098.394164:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:1.0:1788851098.394176:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+32:11377:x1875746000787456:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1788851098.394434:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+33:11377:x1875746000787456:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 260us (702us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788851098.394442:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:1.0:1788851098.499167:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851098.499495:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787712 00000100:00100000:0.0:1788851098.499521:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787712 00000100:00100000:0.0:1788851098.499591:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00100000:0.0:1788851098.499602:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+33:11388:x1875746000787712:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:0.0:1788851098.499629:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851098.499665:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b206075 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b54 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.499742:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.499757:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.499770:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.499785:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.499793:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.499813:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.499946:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b20608a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.499957:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b20608a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.499966:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b20608a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851098.499983:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788851098.500092:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500101:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500108:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500114:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.500119:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500128:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500141:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851098.500144:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.500525:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500534:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b20607c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500549:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500556:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500574:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500580:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bce00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.500583:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500589:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500598:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892d87409b00) 00010000:00010000:0.0:1788851098.500601:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.500604:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500610:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206083 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500957:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b206075 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b54 expref: 36 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500973:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b20608a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b54 expref: 35 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.500980:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:0.0:1788851098.500982:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851098.500985:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc000, rc 0) 00000100:00100000:0.0:1788851098.501242:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+35:11388:x1875746000787712:12345-192.168.204.27@tcp:101:cat.0 Request processed in 1641us (2095us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788851098.501260:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00100000:2.0:1788851098.514712:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.514810:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787968 00000100:00100000:3.0:1788851098.514822:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787968 00000100:00100000:3.0:1788851098.514890:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1788851098.514909:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+35:11388:x1875746000787968:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:3.0:1788851098.515619:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+36:11388:x1875746000787968:12345-192.168.204.27@tcp:35:cat.0 Request processed in 710us (915us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788851098.515641:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1788851098.536992:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851098.537182:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788224 00000100:00100000:1.0:1788851098.537193:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788224 00000100:00100000:1.0:1788851098.537252:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 106 00000100:00100000:1.0:1788851098.537263:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+36:11389:x1875746000788224:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:1.0:1788851098.537323:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788851098.537352:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206028 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b3f expref: 36 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537374:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b20608a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b54 expref: 35 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537387:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206060 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b4d expref: 34 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537398:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20601a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b38 expref: 33 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537429:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:1.0:1788851098.537435:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851098.537461:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537475:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537485:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537500:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537507:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537512:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537588:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537597:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.537604:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851098.538277:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788851098.538290:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432597276182ns, next at 433597273082ns, rc = 0 00010000:00010000:1.0:1788851098.538349:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538360:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538368:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538376:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538382:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538388:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538451:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851098.538473:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538480:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538486:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538492:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851098.538495:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538502:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538519:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:1.0:1788851098.538522:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788851098.538526:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538533:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538551:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538558:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538564:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538569:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851098.538571:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538577:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538584:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:1.0:1788851098.538587:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851098.538589:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538595:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206098 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851098.538618:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e2432c0 reply state 000000000d6f528b transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538629:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.538635:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8dc9b300) 00010000:00010000:1.0:1788851098.538637:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788851098.538640:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851098.538781:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+34:11389:x1875746000788224:12345-192.168.204.27@tcp:36:rm.0 Request processed in 1517us (1795us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788851098.538790:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 106 00010000:00010000:0.0:1788851098.542052:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851098.542070:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.542082:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851098.542087:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.542098:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.542120:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:0.0:1788851098.542123:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788851098.542128:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.542134:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2060ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.542395:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851098.542397:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851098.542400:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851098.551739:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851098.551764:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019742080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851098.551848:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851098.552114:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019742080 00000100:00100000:2.0:1788851098.552123:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019742080 00000100:00100000:2.0:1788851098.552192:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788851098.552202:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019742080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851098.552240:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788851098.552297:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019742080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.552304:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788851098.552855:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019742080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851098.598623:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851098.598846:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788480 00000100:00100000:2.0:1788851098.598857:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788480 00000100:00100000:2.0:1788851098.598946:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:2.0:1788851098.598973:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+34:11395:x1875746000788480:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1788851098.599001:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851098.599063:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2060b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b5b expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.599181:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.599199:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.599211:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.599225:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.599232:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.599239:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851098.599560:0:10526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788851098.600135:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600272:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600282:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600329:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600336:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600342:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600348:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851098.600352:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600359:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600371:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:2.0:1788851098.600374:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851098.600378:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600384:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2060bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851098.600397:0:10526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053e8a872 reply state 00000000224b44b9 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600408:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600413:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8dc9b300) 00010000:00010000:2.0:1788851098.600421:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851098.600425:0:10526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788851098.600456:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2060b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b5b expref: 37 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600472:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b5b expref: 36 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.600479:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892e8a8cbf00) 00010000:00010000:2.0:1788851098.600481:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851098.600483:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6600, rc 0) 00000100:00100000:2.0:1788851098.600599:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+37:11395:x1875746000788480:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1628us (1986us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788851098.600608:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 107 00000100:00100000:2.0:1788851098.605501:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851098.605604:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788608 00000100:00100000:1.0:1788851098.605615:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788608 00000100:00100000:1.0:1788851098.605772:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:1.0:1788851098.605783:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000788608:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1788851098.605880:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851098.605968:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b62 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851098.605994:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851098.606089:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1788851098.606094:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851098.606103:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b62 expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.606144:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b62 expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.606228:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94200, rc 0) 00000100:00100000:1.0:1788851098.606382:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000788608:12345-192.168.204.27@tcp:101:bash.0 Request processed in 600us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.606389:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00080000:2.0:1788851098.606465:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851098.609858:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.610044:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788736 00000100:00100000:3.0:1788851098.610055:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788736 00000100:00100000:3.0:1788851098.610112:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1788851098.610122:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:11395:x1875746000788736:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851098.610141:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851098.610324:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b69 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.610359:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b62 expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.610369:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851098.610373:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851098.610378:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.610409:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b62 expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.610424:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b62 expref: 7 pid: 8447 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.610439:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88286a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1875746019742208:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851098.610548:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851098.614193:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88286a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1875746019742208:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851098.614237:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.614257:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9400, rc 0) 00000100:00100000:0.0:1788851098.614322:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:11395:x1875746000788736:12345-192.168.204.27@tcp:101:bash.0 Request processed in 4200us (4473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.614332:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1788851098.614804:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851098.615004:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788864 00000100:00100000:0.0:1788851098.615041:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788864 00010000:00010000:0.0:1788851098.615075:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b62 expref: 7 pid: 8447 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.615101:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1788851098.615109:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000788864:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851098.615123:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851098.615160:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b62 expref: 7 pid: 8447 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.615173:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b62 expref: 7 pid: 8447 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.615194:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2060d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b62 expref: 7 pid: 8447 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.615208:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851098.615219:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851098.615227:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.615237:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.615271:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.615285:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6519:1875746019742336:192.168.204.27@tcp:105: 00000100:00100000:0.0:1788851098.615363:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788851098.619666:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851098.619896:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789120 00000100:00100000:1.0:1788851098.619908:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789120 00000100:00100000:1.0:1788851098.619964:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1788851098.619974:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+37:11395:x1875746000789120:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:1.0:1788851098.620305:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+38:11395:x1875746000789120:12345-192.168.204.27@tcp:35:bash.0 Request processed in 331us (661us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1788851098.620313:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1788851098.620987:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6519:1875746019742336:192.168.204.27@tcp:105: 00010000:00010000:0.0:1788851098.621029:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851098.621061:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000788864:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 5954us (7058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.621069:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:3.0:1788851098.772841:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851098.773052:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789248 00000100:00100000:0.0:1788851098.773065:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789248 00000100:00100000:0.0:1788851098.773133:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00100000:0.0:1788851098.773144:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+38:11411:x1875746000789248:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851098.773169:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851098.773192:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2060e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b70 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.773256:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2060ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.773283:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2060ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.773295:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2060ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851098.773341:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788851098.773344:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851098.773363:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2060ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.773387:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2060e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b70 expref: 40 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.773404:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2060ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b70 expref: 39 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.773412:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851098.773414:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851098.773418:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc400, rc 0) 00000100:00100000:0.0:1788851098.773487:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+39:11411:x1875746000789248:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 345us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.773494:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00100000:2.0:1788851098.776761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851098.776880:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789504 00000100:00100000:1.0:1788851098.776899:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789504 00000100:00100000:1.0:1788851098.776964:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 109 00000100:00100000:1.0:1788851098.776974:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+39:11411:x1875746000789504:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851098.776995:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851098.777055:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b77 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.777173:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2060fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.777208:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2060fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.777219:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2060fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851098.777231:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788851098.777341:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2060f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b77 expref: 42 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.777361:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2060fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b77 expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.777369:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892e8a8cbf00) 00010000:00010000:1.0:1788851098.777371:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851098.777376:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94c00, rc 0) 00000100:00100000:1.0:1788851098.777446:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+41:11411:x1875746000789504:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 473us (692us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788851098.777453:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 109 00000100:00100000:2.0:1788851098.782614:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.782760:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789760 00000100:00100000:3.0:1788851098.782773:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789760 00000100:00100000:3.0:1788851098.782873:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 110 00000100:00100000:3.0:1788851098.782884:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+41:11411:x1875746000789760:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851098.782923:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851098.782949:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206108 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b7e expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.783271:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20610f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.783289:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20610f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.783300:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20610f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851098.783581:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788851098.783761:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206108 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b7e expref: 44 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.783787:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20610f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b7e expref: 43 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.783857:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892e8a8cbf00) 00010000:00010000:3.0:1788851098.783869:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788851098.783947:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9a00, rc 0) 00000100:00100000:3.0:1788851098.784111:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+43:11411:x1875746000789760:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1228us (1511us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1788851098.784120:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 110 00000100:00100000:2.0:1788851098.787417:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851098.791495:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851098.791595:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790016 00000100:00100000:1.0:1788851098.791609:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790016 00000100:00100000:1.0:1788851098.791671:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:1.0:1788851098.791683:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000790016:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:1.0:1788851098.791737:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.791757:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.791781:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851098.791785:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851098.791801:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.791843:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.791857:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 6 pid: 8449 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.791885:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1875746019742464:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851098.792000:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851098.794144:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1875746019742464:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851098.794174:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.797476:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789888 00000100:00100000:0.0:1788851098.797491:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789888 00000100:00100000:0.0:1788851098.797556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:0.0:1788851098.797566:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+43:2408:x1875746000789888:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851098.797584:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851098.797626:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2060fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b77 expref: 43 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.797648:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892e8a8cbf00) 00010000:00010000:0.0:1788851098.797655:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851098.797720:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+42:2408:x1875746000789888:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 156us (10313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.797728:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851098.797848:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851098.799190:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790144 00000100:00100000:0.0:1788851098.799201:0:8455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790144 00002000:00100000:0.0:1788851098.799249:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff892d88287100 x1875746000790144/t0(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:164/0 lens 504/0 e 0 to 0 dl 1788851109 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788851098.799259:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892d88287100 with x1875746000790144 ext(0->8) 00010000:00010000:0.0:1788851098.799268:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 7 pid: 8449 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.799284:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 7 pid: 8449 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851098.799291:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff892d88287100 00000100:00100000:0.0:1788851098.799314:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:0.0:1788851098.799323:0:8455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000790144:12345-192.168.204.27@tcp:4:lfs.0 00000100:00100000:0.0:1788851098.800787:0:8455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+9:2407:x1875746000790144:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 1458us (2932us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788851098.800806:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00002000:00100000:0.0:1788851098.800816:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff892d88287100 x1875746000790144/t4294967303(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:164/0 lens 504/448 e 0 to 0 dl 1788851109 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788851098.800835:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892d88287100 with x1875746000790144 ext(0->8) 00010000:00010000:0.0:1788851098.800844:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 9 pid: 8449 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.800870:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 9 pid: 8449 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851098.800878:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff892d88287100 00010000:00010000:3.0:1788851098.804224:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851098.805312:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851098.805404:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790272 00000100:00100000:1.0:1788851098.805414:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790272 00010000:00010000:1.0:1788851098.805455:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 9 pid: 8449 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.805500:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:1.0:1788851098.805510:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+9:2409:x1875746000790272:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851098.805540:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788851098.805559:0:6521:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788851098.805562:0:6521:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788851098 00002000:00010000:1.0:1788851098.805564:0:6521:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788851098 00002000:00010000:1.0:1788851098.805566:0:6521:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788851098 00002000:00010000:1.0:1788851098.805568:0:6521:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788851098.805575:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 9 pid: 8449 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.805588:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 9 pid: 8449 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.805610:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006731e985/0x3e0030720b2060de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b69 expref: 9 pid: 8449 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.805627:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851098.805631:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851098.805638:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.805646:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.805698:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851098.805764:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+8:2409:x1875746000790272:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 255us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.805772:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00010000:00010000:2.0:1788851098.805928:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.805940:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.805963:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.805982:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.805990:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.805997:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851098.806003:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.806046:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.806061:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.806069:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b20611d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.806117:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000790016:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 14437us (14633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.806126:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:1.0:1788851098.810436:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851098.810550:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790528 00000100:00100000:2.0:1788851098.810562:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790528 00000100:00100000:2.0:1788851098.810623:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:2.0:1788851098.810708:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ec1c5f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+42:11411:x1875746000790528:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:2.0:1788851098.810777:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20610f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b7e expref: 42 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851098.811095:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788851098.811134:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1788851098.811483:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:2.0:1788851098.811525:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.811538:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b5b expref: 46 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.811547:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.811582:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b5b expref: 46 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.811596:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b5b expref: 46 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.811608:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6537:1875746019742592:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851098.814276:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851098.816760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851098.816961:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790656 00000100:00100000:0.0:1788851098.816972:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790656 00010000:00010000:0.0:1788851098.817054:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b5b expref: 47 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.817089:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:0.0:1788851098.817100:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+47:2408:x1875746000790656:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851098.817116:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851098.817123:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b5b expref: 47 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.817136:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b5b expref: 47 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.817158:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892e8a8cbf00) 00010000:00010000:0.0:1788851098.817163:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.817188:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.817194:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.817214:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851098.817266:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+47:2408:x1875746000790656:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 167us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.817273:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00010000:00010000:2.0:1788851098.818285:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2060c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b5b expref: 46 pid: 10526 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.818307:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6537:1875746019742592:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851098.818345:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.818355:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.818362:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851098.818491:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:2.0:1788851098.818615:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788851098.818726:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019742720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851098.818784:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851098.818828:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851098.819078:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019742720 00000100:00100000:1.0:1788851098.819086:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019742720 00000100:00100000:1.0:1788851098.819134:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788851098.819143:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875746019742720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788851098.819238:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875746019742720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.819246:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788851098.819408:0:6537:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1788851098.819415:0:6537:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1788851098.819432:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892ea7ca1c00, transno 4294967302 00000100:00100000:3.0:1788851098.819454:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019742720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788851098.819569:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:3.0:1788851098.819620:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88285880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019742848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788851098.819805:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851098.819830:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788851098.820763:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019742848 00000100:00100000:2.0:1788851098.820773:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019742848 00000100:00100000:2.0:1788851098.820828:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788851098.820838:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6537:x1875746019742848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851098.821036:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6537:x1875746019742848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 199us (1230us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788851098.821044:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788851098.821363:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88285880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019742848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788851098.821428:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788851098.821473:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.821484:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.821491:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.821497:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851098.821502:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.821523:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.821539:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892e8a8cbf00) 00010000:00010000:3.0:1788851098.821542:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788851098.821547:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.821552:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b206124 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788851098.821666:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788851098.821721:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788851098.821733:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 432880719273ns, next at 433880716819ns, rc = 0 00000001:00080000:3.0:1788851098.821739:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:3.0:1788851098.821764:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892e8a8cbf00) 00010000:00010000:3.0:1788851098.821767:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788851098.821774:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20610f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b7e expref: 50 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.822070:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ec1c5f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+49:11411:x1875746000790528:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 11421us (11643us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788851098.822078:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000020:00080000:3.0:1788851098.822082:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788851098.825137:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851098.825236:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790784 00000100:00100000:0.0:1788851098.825246:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790784 00000100:00100000:0.0:1788851098.825314:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 111 00000100:00100000:0.0:1788851098.825324:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+49:11411:x1875746000790784:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851098.825352:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851098.825377:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b20612b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b85 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.825440:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b20612b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b85 expref: 50 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.825455:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b20612b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b85 expref: 50 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.825473:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851098.825476:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851098.825480:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bdc00, rc 0) 00000100:00100000:0.0:1788851098.825565:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+50:11411:x1875746000790784:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 242us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.825571:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 111 00000100:00100000:0.0:1788851098.828321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.828400:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791040 00000100:00100000:3.0:1788851098.828409:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791040 00000100:00100000:3.0:1788851098.828464:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1788851098.828474:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+50:11411:x1875746000791040:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851098.828727:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+51:11411:x1875746000791040:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 254us (414us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788851098.828735:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1788851098.907780:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851098.907900:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791168 00000100:00100000:0.0:1788851098.907914:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791168 00000100:00100000:0.0:1788851098.907986:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 112 00000100:00100000:0.0:1788851098.907997:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+51:11421:x1875746000791168:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:0.0:1788851098.908107:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908125:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908136:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908147:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908154:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908160:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908246:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908255:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908282:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851098.908353:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908366:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908372:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908378:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908384:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.908389:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908396:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908408:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851098.908411:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.908416:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908421:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206132 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908433:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908446:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908452:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908458:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.908461:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908467:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908475:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8dc9b300) 00010000:00010000:0.0:1788851098.908477:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.908480:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908485:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206139 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908495:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908501:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908507:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908511:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bda00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.908520:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908526:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908534:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851098.908536:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.908539:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.908545:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206140 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.908630:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+51:11421:x1875746000791168:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 634us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.908639:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 112 00000100:00100000:0.0:1788851098.959845:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.960233:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791424 00000100:00100000:3.0:1788851098.960246:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791424 00000100:00100000:0.0:1788851098.960409:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 113 00000100:00100000:0.0:1788851098.960423:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+51:11424:x1875746000791424:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851098.960444:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851098.960464:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206147 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b8c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.960536:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.960552:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.960567:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.960594:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.960604:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.960612:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.960740:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.960749:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.960757:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851098.960767:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788851098.961038:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961047:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961053:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961059:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.961064:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961082:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961095:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:0.0:1788851098.961097:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.961103:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961108:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20614e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961121:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961126:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961132:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961137:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851098.961140:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961146:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961153:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8dc9b300) 00010000:00010000:0.0:1788851098.961155:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.961158:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961174:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b206155 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961212:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b206147 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b8c expref: 54 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961224:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b8c expref: 53 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.961231:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851098.961233:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851098.961236:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bca00, rc 0) 00000100:00100000:0.0:1788851098.961307:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+53:11424:x1875746000791424:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 888us (1474us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788851098.962196:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 113 00000100:00100000:3.0:1788851098.966285:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851098.966418:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791552 00000100:00100000:1.0:1788851098.966429:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791552 00000100:00100000:1.0:1788851098.966490:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 114 00000100:00100000:1.0:1788851098.966500:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+53:11424:x1875746000791552:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1788851098.966568:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.966583:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.966594:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.966629:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.966635:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.966642:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.966648:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851098.966667:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.966675:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.966688:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:1.0:1788851098.966692:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851098.966696:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.966702:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b20616a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.966799:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+53:11424:x1875746000791552:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 291us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.966807:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 114 00000100:00100000:2.0:1788851098.973362:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851098.973469:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791808 00000100:00100000:3.0:1788851098.973479:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791808 00000100:00100000:3.0:1788851098.973534:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1788851098.973547:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+53:11424:x1875746000791808:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851098.973778:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+54:11424:x1875746000791808:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 234us (425us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788851098.973785:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1788851099.065051:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851099.065152:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792064 00000100:00100000:1.0:1788851099.065163:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792064 00000100:00100000:1.0:1788851099.065224:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:1.0:1788851099.065235:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+54:11434:x1875746000792064:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1788851099.065258:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851099.065262:0:9543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788851099.065292:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2060ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b70 expref: 54 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.065322:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:1.0:1788851099.065328:0:9543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851099.065342:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206171 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b93 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.065480:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.065494:0:9543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b8c expref: 54 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.065502:0:9543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.065536:0:9543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b8c expref: 54 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.065549:0:9543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b8c expref: 54 pid: 6534 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851099.065563:0:9543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019742976:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851099.065647:0:9543:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788851099.070340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851099.070807:0:9543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019742976:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851099.070835:0:9543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851099.071532:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792192 00000100:00100000:3.0:1788851099.071543:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792192 00010000:00010000:3.0:1788851099.071583:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b8c expref: 55 pid: 6534 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851099.071625:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:3.0:1788851099.071636:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+55:2407:x1875746000792192:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851099.071664:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851099.071672:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b8c expref: 55 pid: 6534 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.071683:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b8c expref: 55 pid: 6534 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.071720:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b20615c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b8c expref: 55 pid: 6534 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.071735:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:3.0:1788851099.071740:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.071748:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.071756:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.071789:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851099.071850:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+54:2407:x1875746000792192:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 216us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851099.071868:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00010000:00010000:0.0:1788851099.072227:0:9543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.072238:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851099.072259:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788851099.072406:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206171 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b93 expref: 55 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.072423:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b93 expref: 54 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.072442:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851099.072445:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788851099.072448:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95e00, rc 0) 00000100:00100000:0.0:1788851099.072500:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+54:11434:x1875746000792064:12345-192.168.204.27@tcp:101:bash.0 Request processed in 7267us (7492us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788851099.072507:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:0.0:1788851099.078933:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851099.079361:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792320 00000100:00100000:3.0:1788851099.079372:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792320 00000100:00100000:3.0:1788851099.079438:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:3.0:1788851099.079449:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+54:11434:x1875746000792320:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851099.079477:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851099.079500:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206186 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38b9a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.079534:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.079566:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.079577:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.079689:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206186 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b9a expref: 56 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.079707:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b9a expref: 55 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.079715:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:3.0:1788851099.079718:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851099.079722:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8800, rc 0) 00000100:00100000:3.0:1788851099.079827:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+55:11434:x1875746000792320:12345-192.168.204.27@tcp:101:bash.0 Request processed in 379us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851099.079834:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:2.0:1788851099.085122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851099.085206:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792576 00000100:00100000:0.0:1788851099.085217:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792576 00000100:00100000:0.0:1788851099.085280:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:0.0:1788851099.085290:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+55:11434:x1875746000792576:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:0.0:1788851099.085519:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.085536:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.085547:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851099.085597:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:0.0:1788851099.085621:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8933549 reply state 000000000fffcacc transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.085635:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.085642:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851099.085675:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851099.085680:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851099.085783:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+58:11434:x1875746000792576:12345-192.168.204.27@tcp:36:bash.0 Request processed in 493us (670us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788851099.085800:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000020:00080000:0.0:1788851099.085805:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788851099.089757:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851099.089932:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792704 00000100:00100000:0.0:1788851099.089942:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792704 00000100:00100000:0.0:1788851099.090004:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:0.0:1788851099.090162:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+58:11434:x1875746000792704:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1788851099.090250:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851099.090273:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20619b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ba1 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.090367:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.090402:0:9543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b93 expref: 59 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.090412:0:9543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.090449:0:9543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b93 expref: 59 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.090463:0:9543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b93 expref: 59 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851099.090478:0:9543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019743104:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851099.090568:0:9543:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788851099.093593:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851099.093720:0:9543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019743104:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851099.093750:0:9543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851099.094055:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792832 00000100:00100000:0.0:1788851099.094063:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792832 00010000:00010000:0.0:1788851099.094099:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b93 expref: 60 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851099.094129:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:0.0:1788851099.094139:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+60:2407:x1875746000792832:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851099.094154:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851099.094160:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b93 expref: 60 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.094173:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b93 expref: 60 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.094195:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206178 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b93 expref: 60 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.094211:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851099.094222:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.094233:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.094241:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.094270:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851099.094382:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+59:2407:x1875746000792832:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 243us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851099.094391:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00010000:00010000:2.0:1788851099.094611:0:9543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.094620:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851099.094689:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788851099.094694:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851099.094716:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.094748:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20619b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba1 expref: 59 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.094764:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba1 expref: 58 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.094773:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:2.0:1788851099.094776:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851099.094779:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94200, rc 0) 00000100:00100000:2.0:1788851099.094820:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+58:11434:x1875746000792704:12345-192.168.204.27@tcp:101:bash.0 Request processed in 4807us (5075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851099.094827:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:2.0:1788851099.098582:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851099.098767:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793088 00000100:00100000:3.0:1788851099.098778:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793088 00000100:00100000:3.0:1788851099.098998:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:3.0:1788851099.099040:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+58:11434:x1875746000793088:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1788851099.099313:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+59:11434:x1875746000793088:12345-192.168.204.27@tcp:35:bash.0 Request processed in 305us (741us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788851099.099322:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1788851099.163870:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851099.164068:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793216 00000100:00100000:1.0:1788851099.164079:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793216 00000100:00100000:1.0:1788851099.164130:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:1.0:1788851099.164139:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+59:11440:x1875746000793216:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851099.164164:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851099.164186:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2061a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ba8 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.164257:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2061b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.164273:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2061b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.164300:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2061b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851099.164347:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788851099.164351:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851099.164370:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2061b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.164397:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2061a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba8 expref: 61 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.164416:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2061b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba8 expref: 60 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.164423:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:1.0:1788851099.164426:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851099.164429:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94c00, rc 0) 00000100:00100000:1.0:1788851099.164487:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+60:11440:x1875746000793216:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 349us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851099.164494:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:1.0:1788851099.168480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851099.168572:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793344 00000100:00100000:3.0:1788851099.168583:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793344 00000100:00100000:3.0:1788851099.168666:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:3.0:1788851099.168677:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+60:11440:x1875746000793344:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851099.168698:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851099.168720:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b2061b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38baf expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.168785:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.168813:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.168825:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.168838:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.168845:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.168864:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.168955:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b2061cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.168965:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b2061cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.168972:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b2061cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851099.169073:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788851099.169078:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851099.169097:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b2061cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169109:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b2061cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169118:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169124:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169131:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169136:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851099.169141:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169149:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169161:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:3.0:1788851099.169163:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851099.169168:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169176:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2061be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169201:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169207:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169212:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169217:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851099.169220:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169226:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169233:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8dc9b300) 00010000:00010000:3.0:1788851099.169236:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851099.169239:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169245:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b2061c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169269:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b2061b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38baf expref: 62 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169283:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b2061cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38baf expref: 61 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851099.169302:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:3.0:1788851099.169304:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851099.169307:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8e00, rc 0) 00000100:00100000:3.0:1788851099.169369:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+61:11440:x1875746000793344:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 694us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851099.169376:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:2.0:1788851099.175183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851099.175280:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793472 00000100:00100000:1.0:1788851099.175291:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793472 00000100:00100000:1.0:1788851099.175364:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:1.0:1788851099.175374:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+61:2409:x1875746000793472:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851099.175391:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851099.175416:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b2061cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38baf expref: 61 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.175449:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:1.0:1788851099.175454:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851099.175513:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+60:2409:x1875746000793472:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 140us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851099.175521:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1788851099.178148:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851099.178355:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793728 00000100:00100000:1.0:1788851099.178366:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793728 00000100:00100000:1.0:1788851099.178426:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:1.0:1788851099.178437:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+60:11440:x1875746000793728:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851099.178459:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851099.178480:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2061d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38bb6 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.178622:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.178637:0:9543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba1 expref: 61 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.178646:0:9543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.178683:0:9543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba1 expref: 61 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.178696:0:9543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba1 expref: 61 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851099.178721:0:9543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019743232:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851099.178822:0:9543:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851099.181400:0:9543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019743232:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851099.181431:0:9543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851099.184459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851099.184567:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793856 00000100:00100000:0.0:1788851099.184579:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793856 00010000:00010000:0.0:1788851099.184620:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba1 expref: 62 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851099.184674:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:0.0:1788851099.184684:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+62:2407:x1875746000793856:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851099.184700:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851099.184707:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba1 expref: 62 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.184721:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba1 expref: 62 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.184743:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b2061a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba1 expref: 62 pid: 9543 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.184773:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851099.184778:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.184788:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.184806:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.184841:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851099.184916:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+61:2407:x1875746000793856:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 233us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851099.184924:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00010000:00010000:2.0:1788851099.185038:0:9543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.185046:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851099.185066:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788851099.185191:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2061d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bb6 expref: 62 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.185208:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bb6 expref: 61 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.185216:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:2.0:1788851099.185219:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851099.185222:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94000, rc 0) 00000100:00100000:2.0:1788851099.185246:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+61:11440:x1875746000793728:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 6812us (7109us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788851099.185253:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:2.0:1788851099.189715:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851099.189797:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794112 00000100:00100000:1.0:1788851099.189808:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794112 00000100:00100000:1.0:1788851099.189890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:1.0:1788851099.189901:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+61:11440:x1875746000794112:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:1.0:1788851099.189916:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851099.189937:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b20612b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b85 expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.189955:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:1.0:1788851099.189961:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851099.190470:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+60:11440:x1875746000794112:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 568us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851099.190478:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1788851099.193006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851099.193244:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794240 00000100:00100000:0.0:1788851099.193254:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794240 00000100:00100000:0.0:1788851099.193348:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:0.0:1788851099.193359:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+60:11440:x1875746000794240:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:0.0:1788851099.193479:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.193496:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.193508:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851099.193605:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788851099.193921:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+60:11440:x1875746000794240:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 562us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851099.193937:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:1.0:1788851099.200056:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851099.200145:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794368 00000100:00100000:0.0:1788851099.200156:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794368 00000100:00100000:0.0:1788851099.200221:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:0.0:1788851099.200232:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+60:11440:x1875746000794368:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851099.200255:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851099.200275:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38bbd expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.200342:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.200354:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bbd expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.200373:0:6534:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.200388:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bbd expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.200402:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851099.200405:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851099.200409:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bbd expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.200417:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bd800, rc 0) 00000100:00100000:0.0:1788851099.200494:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+61:11440:x1875746000794368:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 263us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851099.200502:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00010000:00010000:0.0:1788851099.828751:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851100.212346:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851100.212356:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851100.212419:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788851100.212432:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788851100.212597:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019743360:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851100.212794:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851100.218091:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019743360:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788851100.229761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.229897:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794496 00000100:00100000:2.0:1788851100.229909:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794496 00000100:00100000:2.0:1788851100.230059:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:2.0:1788851100.230070:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+61:11441:x1875746000794496:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1788851100.230088:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1788851100.230101:0:9543:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788851100.230255:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+61:11441:x1875746000794496:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 186us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851100.230273:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:1.0:1788851100.236444:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851100.236663:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794624 00000100:00100000:0.0:1788851100.236676:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794624 00000100:00100000:0.0:1788851100.236763:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:0.0:1788851100.236773:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+61:11441:x1875746000794624:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788851100.236864:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.236883:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.236897:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.236921:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.236929:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.236936:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.236960:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.236968:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.236996:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851100.237425:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788851100.237431:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851100.237454:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237467:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237475:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237485:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237491:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851100.237496:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237504:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237515:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:0.0:1788851100.237518:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851100.237523:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237528:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2061f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237554:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237559:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237565:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237569:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bde00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851100.237572:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237578:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237585:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff892d87409000) 00010000:00010000:0.0:1788851100.237587:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851100.237590:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237595:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2061fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237607:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237612:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237619:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237643:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bdc00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851100.237646:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237652:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237661:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851100.237664:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851100.237668:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.237674:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206204 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851100.237771:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+61:11441:x1875746000794624:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 997us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851100.237780:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:3.0:1788851100.243896:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.244235:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794880 00000100:00100000:1.0:1788851100.244252:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794880 00000100:00100000:1.0:1788851100.244328:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:1.0:1788851100.244341:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+61:11441:x1875746000794880:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851100.244365:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851100.244390:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b20620b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38bc4 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244520:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244535:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244547:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851100.244558:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788851100.244638:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244647:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244654:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244660:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851100.244665:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244690:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244703:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:1.0:1788851100.244707:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788851100.244712:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244718:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206212 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244764:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b20620b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bc4 expref: 63 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244775:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:1.0:1788851100.244777:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851100.244780:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b20620b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bc4 expref: 63 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.244788:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95e00, rc 0) 00000100:00100000:1.0:1788851100.245232:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+62:11441:x1875746000794880:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 891us (1347us total) trans 4294967400 rc 301/301 00000100:00100000:1.0:1788851100.245241:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:3.0:1788851100.261196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851100.261380:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795008 00000100:00100000:0.0:1788851100.261392:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795008 00000100:00100000:0.0:1788851100.261457:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:0.0:1788851100.261470:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+62:11441:x1875746000795008:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851100.261514:0:10526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851100.261890:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+62:11441:x1875746000795008:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 420us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851100.261898:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:0.0:1788851100.266901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.267085:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795264 00000100:00100000:2.0:1788851100.267095:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795264 00000100:00100000:2.0:1788851100.267159:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:2.0:1788851100.267169:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+62:11441:x1875746000795264:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851100.267192:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851100.267195:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788851100.267221:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b2061b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ba8 expref: 62 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.267242:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:2.0:1788851100.267247:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851100.267261:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b206220 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38bcb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851100.267641:0:6535:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788851100.269493:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206227 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.269511:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.269524:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.269590:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b206220 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bcb expref: 64 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.271149:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206227 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bcb expref: 63 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.271165:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892e8a8cb000) 00010000:00010000:2.0:1788851100.271169:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851100.271173:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7600, rc 0) 00000100:00100000:3.0:1788851100.271584:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+63:11441:x1875746000795264:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 4413us (4692us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788851100.271594:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:2.0:1788851100.280494:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.280986:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795520 00000100:00100000:1.0:1788851100.280996:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795520 00000100:00100000:1.0:1788851100.281111:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:1.0:1788851100.281121:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+63:11441:x1875746000795520:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788851100.281190:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851100.281218:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206227 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bcb expref: 63 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281239:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892e8a8cb000) 00010000:00010000:1.0:1788851100.281250:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851100.281271:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281286:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281296:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281308:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281315:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281321:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281362:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281369:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281376:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281386:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851100.281391:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281398:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281405:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:1.0:1788851100.281408:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851100.281412:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281418:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206235 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281426:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281431:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281438:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281442:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851100.281445:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281451:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281465:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa818480f (ffff892e8dc9b700) 00010000:00010000:1.0:1788851100.281467:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851100.281470:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.281476:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b20623c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa818480f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.281563:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+62:11441:x1875746000795520:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 443us (1077us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851100.281570:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:2.0:1788851100.284596:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.286745:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795648 00000100:00100000:3.0:1788851100.286760:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795648 00000100:00100000:3.0:1788851100.286860:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:3.0:1788851100.286873:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+62:11441:x1875746000795648:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851100.286894:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851100.286916:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206243 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38bd2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.287606:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.287653:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.287666:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.287783:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206243 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd2 expref: 64 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.287804:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd2 expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.287812:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:3.0:1788851100.287814:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851100.287818:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9600, rc 0) 00000100:00100000:3.0:1788851100.287898:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+63:11441:x1875746000795648:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1027us (3312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.287906:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:2.0:1788851100.293780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.293976:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795904 00000100:00100000:3.0:1788851100.293988:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795904 00000100:00100000:3.0:1788851100.294084:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:3.0:1788851100.294096:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+63:11441:x1875746000795904:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851100.294191:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.294211:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.294245:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851100.294478:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1788851100.294489:0:6535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434353475196ns, next at 435353472410ns, rc = 0 00000004:00010000:3.0:1788851100.294549:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066bcd37b reply state 00000000d667dd38 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.294564:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.294572:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:3.0:1788851100.294576:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788851100.294580:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851100.294815:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+65:11441:x1875746000795904:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 720us (1049us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788851100.294823:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:0.0:1788851100.301867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.301967:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796032 00000100:00100000:1.0:1788851100.301981:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796032 00000100:00100000:1.0:1788851100.302074:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:1.0:1788851100.302084:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+65:11441:x1875746000796032:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851100.302105:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851100.302125:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38bd9 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.302182:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd9 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.302196:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd9 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.302214:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:1.0:1788851100.302217:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851100.302227:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94200, rc 0) 00000100:00100000:1.0:1788851100.302279:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+66:11441:x1875746000796032:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 197us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851100.302286:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:2.0:1788851100.306198:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.306515:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796160 00000100:00100000:3.0:1788851100.306770:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796160 00000100:00100000:3.0:1788851100.306874:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:3.0:1788851100.306884:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000796160:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788851100.307147:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851100.307198:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+9:2408:x1875746000796160:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 313us (1005us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788851100.307207:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:2.0:1788851100.311478:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851100.311672:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796416 00000100:00100000:0.0:1788851100.311682:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796416 00000100:00100000:0.0:1788851100.311753:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1788851100.311765:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+66:11441:x1875746000796416:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788851100.312281:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+67:11441:x1875746000796416:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 517us (814us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1788851100.312291:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1788851100.314786:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.314972:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796672 00000100:00100000:3.0:1788851100.314982:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796672 00000100:00100000:3.0:1788851100.315071:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:3.0:1788851100.315081:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+67:11441:x1875746000796672:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788851100.315214:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+67:11441:x1875746000796672:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 133us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.315222:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:2.0:1788851100.317744:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.318068:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796800 00000100:00100000:3.0:1788851100.318079:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796800 00000100:00100000:3.0:1788851100.318201:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:3.0:1788851100.318213:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+67:11441:x1875746000796800:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851100.318236:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851100.318260:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20625f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38be0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.318328:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206266 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.318342:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.318354:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851100.318403:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851100.318424:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.318452:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20625f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be0 expref: 69 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.318746:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be0 expref: 68 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.318863:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:3.0:1788851100.318868:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788851100.318872:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8c00, rc 0) 00000100:00100000:3.0:1788851100.318943:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+68:11441:x1875746000796800:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 733us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.318951:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:2.0:1788851100.325801:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.325933:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796928 00000100:00100000:1.0:1788851100.325945:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796928 00000100:00100000:1.0:1788851100.326188:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:1.0:1788851100.326204:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+9:2407:x1875746000796928:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851100.326238:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851100.326267:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38be7 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851100.326301:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb39b, blocks: 0x0 00010000:00010000:1.0:1788851100.326327:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788851100.326332:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851100.326343:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be7 expref: 10 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.326366:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be7 expref: 10 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.326381:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95e00, rc 0) 00000100:00100000:1.0:1788851100.326457:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+10:2407:x1875746000796928:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 256us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851100.326465:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1788851100.329293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.330771:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797184 00000100:00100000:2.0:1788851100.330783:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797184 00000100:00100000:2.0:1788851100.330876:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:2.0:1788851100.330887:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+68:11441:x1875746000797184:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788851100.331145:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+68:11441:x1875746000797184:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 259us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851100.331152:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:3.0:1788851100.334973:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851100.335282:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797312 00000100:00100000:0.0:1788851100.335386:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797312 00000100:00100000:0.0:1788851100.335493:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1788851100.335504:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+10:11441:x1875746000797312:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851100.335525:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851100.335546:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38bee expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.335581:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be7 expref: 11 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.335590:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851100.335594:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851100.335600:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.335634:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be7 expref: 11 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.335663:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be7 expref: 11 pid: 8447 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851100.335677:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875746019743488:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851100.335827:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851100.339578:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875746019743488:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851100.339618:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.339644:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc400, rc 0) 00000100:00100000:3.0:1788851100.339715:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+11:11441:x1875746000797312:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 4212us (4751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.339724:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1788851100.342697:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851100.342898:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797440 00000100:00100000:0.0:1788851100.342910:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797440 00010000:00010000:0.0:1788851100.342956:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be7 expref: 11 pid: 8447 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851100.343097:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:0.0:1788851100.343110:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+11:2408:x1875746000797440:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851100.343130:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851100.343153:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be7 expref: 11 pid: 8447 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.343168:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be7 expref: 11 pid: 8447 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.343194:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000452df3c6/0x3e0030720b20626d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be7 expref: 11 pid: 8447 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.343214:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851100.343239:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851100.343251:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 10 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.343261:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 10 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.343302:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 10 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851100.343318:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88399180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6520:1875746019743616:192.168.204.27@tcp:105: 00000100:00100000:0.0:1788851100.343423:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788851100.347189:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88399180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6520:1875746019743616:192.168.204.27@tcp:105: 00010000:00010000:0.0:1788851100.347219:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851100.347285:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+10:2408:x1875746000797440:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 4177us (4594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851100.347297:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 73 00000100:00100000:2.0:1788851100.350114:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.350299:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797568 00000100:00100000:1.0:1788851100.350311:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797568 00002000:00100000:1.0:1788851100.350371:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff892d87bf0a80 x1875746000797568/t0(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:166/0 lens 504/0 e 0 to 0 dl 1788851111 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851100.350383:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892d87bf0a80 with x1875746000797568 ext(0->12) 00002000:00010000:1.0:1788851100.350390:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892d87bf0a80 00000100:00100000:1.0:1788851100.350422:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1788851100.350432:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+10:2408:x1875746000797568:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788851100.352694:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+12:2408:x1875746000797568:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 2251us (2577us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788851100.352710:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00002000:00100000:1.0:1788851100.352722:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff892d87bf0a80 x1875746000797568/t4294967309(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:166/0 lens 504/448 e 0 to 0 dl 1788851111 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851100.352733:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892d87bf0a80 with x1875746000797568 ext(0->12) 00002000:00010000:1.0:1788851100.352740:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892d87bf0a80 00000100:00100000:1.0:1788851100.356175:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851100.356342:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797696 00000100:00100000:0.0:1788851100.356352:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797696 00000100:00100000:0.0:1788851100.356455:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:0.0:1788851100.356476:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+68:11441:x1875746000797696:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788851100.362077:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:2.0:1788851100.362100:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788851100.362137:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:3.0:1788851100.362336:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362349:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362358:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362364:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851100.362368:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362394:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362592:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff892d81099a00) 00010000:00010000:3.0:1788851100.362597:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851100.362602:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362609:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b205f79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362641:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362647:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362653:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362658:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851100.362661:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362667:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362674:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851100.362677:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851100.362680:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362697:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206021 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362715:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362720:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362726:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362731:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851100.362734:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362740:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362748:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8dc9b300) 00010000:00010000:3.0:1788851100.362751:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851100.362754:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362760:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b20609f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362770:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362777:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362790:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362795:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851100.362798:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362804:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362813:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892e8dc9b300) 00010000:00010000:3.0:1788851100.362815:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851100.362818:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362823:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2060c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362849:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362855:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362861:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362865:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851100.362867:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362884:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362891:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:3.0:1788851100.362894:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851100.362896:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362901:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206194 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362912:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362918:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362923:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362927:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851100.362929:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362935:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362941:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:3.0:1788851100.362943:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851100.362946:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.362962:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206251 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.363324:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851100.363342:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019743744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788851100.363562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851100.363626:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019743744 00000100:00100000:1.0:1788851100.363635:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019743744 00000100:00100000:1.0:1788851100.363691:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788851100.363700:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019743744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788851100.363729:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1788851100.363751:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.363781:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b46 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.363789:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788851100.363793:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851100.363798:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.363826:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b46 expref: 11 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.363852:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b46 expref: 11 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.363865:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1875746019744000:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851100.363927:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb7480 going to sleep for 11 seconds 00000100:00080000:1.0:1788851100.363945:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851100.364213:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851100.364295:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019743872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788851100.364330:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851100.364365:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019743872 00000100:00100000:3.0:1788851100.364369:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019743872 00000100:00100000:3.0:1788851100.364396:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788851100.365604:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019743872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788851100.365743:0:8625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788851100.365747:0:8625:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788851099 00002000:00010000:3.0:1788851100.365749:0:8625:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788851100.365752:0:8625:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788851099 -> 1788851099 00002000:00010000:3.0:1788851100.365754:0:8625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788851100.365829:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3648:x1875746019743872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1424us (1496us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788851100.365847:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1788851100.365910:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892ea7d65500/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788851100.365917:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019743872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788851100.369774:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.369804:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797824 00000100:00100000:3.0:1788851100.369813:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797824 00010000:00010000:3.0:1788851100.369867:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b46 expref: 12 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851100.369921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:3.0:1788851100.369931:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+12:2407:x1875746000797824:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851100.369947:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851100.369953:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b46 expref: 12 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.369966:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b46 expref: 12 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.369991:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851100.369995:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851100.370002:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.370035:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.370058:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851100.370104:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+12:2407:x1875746000797824:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 175us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.370111:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 74 00010000:00010000:1.0:1788851100.370371:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d439510b/0x3e0030720b20602f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b46 expref: 11 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.370386:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1875746019744000:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851100.370421:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.370444:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.370451:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.370460:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.370468:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.370489:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788851100.370652:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3649:x1875746019743744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6952us (7091us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788851100.370660:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:1.0:1788851100.370697:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892ea7d67800/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788851100.370704:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019743744:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788851100.370917:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851100.370924:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.370944:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851100.370948:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.370958:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.370973:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.370980:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb309f8d/0x3e0030720b20627b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.370998:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851100.370999:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851100.371001:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851100.371480:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019744128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788851100.371539:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851100.371565:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019744128 00000100:00100000:1.0:1788851100.371572:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019744128 00000100:00100000:1.0:1788851100.371620:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788851100.371629:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019744128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788851100.371666:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:1.0:1788851100.371696:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fb39a, atime: 0x6a9fb39a, ctime: 0x6a9fb39a, blocks: 0x8 00010000:00010000:1.0:1788851100.371712:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.371725:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788851100.371729:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851100.371734:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.371749:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.371758:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.371766:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.371782:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851100.371917:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851100.371924:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.371932:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851100.371941:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.371949:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.371963:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.371970:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206282 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.371987:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851100.371989:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851100.371991:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788851100.372358:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff892ea59c9000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788851100.372372:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892e83306b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff892ea59c9a80 00000020:00080000:2.0:1788851100.372376:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892e83306f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff892e980ed400 00000004:00080000:2.0:1788851100.372407:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788851100.372437:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff892ea58ab240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788851100.372441:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892d87bb1500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff892ea58ab540 00000020:00080000:2.0:1788851100.372444:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892d87bb1b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff892d87bbb600 00000020:00080000:0.0:1788851100.372539:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1788851100.373140:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019744128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1508us (1609us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788851100.373152:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788851100.373186:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788851100.373352:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892d8839a680/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788851100.373359:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019744128:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788851100.374165:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788851100.374518:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+16:11441:x1875746000797696:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 18049us (18351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851100.374538:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:3.0:1788851100.378206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851100.378331:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797952 00000100:00100000:0.0:1788851100.378343:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797952 00000100:00100000:0.0:1788851100.378461:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:0.0:1788851100.378484:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+11:2407:x1875746000797952:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788851100.382092:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788851100.382111:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1788851100.382640:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000797952:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 4153us (4438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851100.382655:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:1.0:1788851100.386477:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.386741:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798208 00000100:00100000:3.0:1788851100.386754:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798208 00000100:00100000:3.0:1788851100.386894:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:3.0:1788851100.386906:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+16:11441:x1875746000798208:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851100.386966:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851100.386993:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206266 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38be0 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.387065:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:3.0:1788851100.387071:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851100.387107:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.387123:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.387133:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851100.387971:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc85a6e8 reply state 00000000be150a3b transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.387986:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.387994:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:3.0:1788851100.387997:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851100.388000:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851100.388230:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+17:11441:x1875746000798208:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 1324us (1771us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1788851100.388240:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:1.0:1788851100.391667:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.391821:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798336 00000100:00100000:2.0:1788851100.391847:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798336 00000100:00100000:2.0:1788851100.391944:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1788851100.391956:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2408:x1875746000798336:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788851100.392529:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788851100.392534:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788851099 -> 1788851098 00002000:00010000:2.0:1788851100.392537:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788851098 00002000:00010000:2.0:1788851100.392539:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788851099 -> 1788851098 00002000:00010000:2.0:1788851100.392542:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788851100.392611:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000798336:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 656us (957us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788851100.392621:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1788851100.395654:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.395756:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798592 00000100:00100000:1.0:1788851100.395845:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798592 00000100:00100000:1.0:1788851100.396004:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:1.0:1788851100.396043:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+17:11441:x1875746000798592:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788851100.396132:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.396150:0:9543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd2 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.396160:0:9543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.396194:0:9543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd2 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.396208:0:9543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd2 expref: 17 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.396237:0:9543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019744256:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851100.396320:0:9543:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788851100.399827:0:9543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9543:1875746019744256:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851100.399868:0:9543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851100.400576:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.401618:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798720 00000100:00100000:1.0:1788851100.401629:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798720 00010000:00010000:1.0:1788851100.401731:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd2 expref: 18 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.403130:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:1.0:1788851100.403151:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+18:2408:x1875746000798720:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851100.403198:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851100.403209:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd2 expref: 18 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851100.404845:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.404887:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.404918:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.404939:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.404966:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.405000:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799360 00000100:00100000:2.0:1788851100.405038:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799360 00000100:00100000:2.0:1788851100.405092:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798976 00000100:00100000:2.0:1788851100.405095:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798976 00000100:00100000:2.0:1788851100.405110:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799232 00000100:00100000:2.0:1788851100.405112:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799232 00000100:00100000:2.0:1788851100.405131:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:2.0:1788851100.405140:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000799360:12345-192.168.204.27@tcp:400:kworker.0 00010000:00010000:1.0:1788851100.405343:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd2 expref: 18 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.405370:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20624a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd2 expref: 18 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.405390:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:1.0:1788851100.405395:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851100.405513:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798848 00000100:00100000:3.0:1788851100.405518:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798848 00000100:00100000:3.0:1788851100.405549:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 386 00000100:00100000:3.0:1788851100.405556:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2408:x1875746000798848:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851100.405583:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2408:x1875746000798848:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.405590:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 386 00010000:00010000:1.0:1788851100.405926:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.405936:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.405977:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851100.406007:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+17:2408:x1875746000798720:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 2864us (5433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851100.406052:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00010000:00010000:3.0:1788851100.406116:0:9543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.406124:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.406169:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.406177:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.406185:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.406191:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851100.406196:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.406203:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.406228:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:3.0:1788851100.406232:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788851100.406246:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.406253:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206290 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851100.406294:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+16:11441:x1875746000798592:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 10280us (10649us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788851100.406302:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:3.0:1788851100.406321:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 299 00000100:00100000:3.0:1788851100.406329:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000798976:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851100.406358:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000798976:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.406364:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 299 00000100:00100000:3.0:1788851100.406378:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 300 00000100:00100000:3.0:1788851100.406384:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000799232:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851100.407113:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000799360:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851100.407124:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 298 00000100:00100000:3.0:1788851100.407273:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000799232:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 887us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.407281:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 300 00000100:00080000:1.0:1788851100.408964:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851100.408975:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851100.408995:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799104 00000100:00100000:1.0:1788851100.409004:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799104 00000100:00100000:1.0:1788851100.410323:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:1.0:1788851100.410342:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000799104:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851100.410412:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000799104:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 77us (5524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851100.410433:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00080000:2.0:1788851100.410580:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851100.414505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.414593:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799488 00000100:00100000:1.0:1788851100.414603:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799488 00000100:00100000:1.0:1788851100.414668:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:1.0:1788851100.414678:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000799488:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788851100.414731:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.414754:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.414763:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851100.414779:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851100.414785:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.414822:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.414848:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 7 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.414875:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1875746019744384:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851100.415053:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851100.420682:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.420759:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799616 00000100:00100000:3.0:1788851100.420774:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799616 00010000:00010000:3.0:1788851100.420814:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 8 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851100.420879:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:3.0:1788851100.420889:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000799616:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851100.420924:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851100.420949:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 8 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.420963:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 8 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.420989:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851100.420994:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851100.421000:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.421010:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.421068:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851100.421117:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000799616:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 229us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.421124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00010000:00010000:1.0:1788851100.425339:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206274 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bee expref: 7 pid: 8449 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.425390:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1875746019744384:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851100.425498:0:8625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.425512:0:8625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.425521:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.425556:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.425564:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.425574:0:8625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.425581:0:8625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851100.425586:0:8625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.425595:0:8625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.425624:0:8625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.425632:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b206297 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.425900:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000799488:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 11221us (11402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851100.425911:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:0.0:1788851100.428454:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.428554:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799872 00000100:00100000:2.0:1788851100.428566:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799872 00000100:00100000:2.0:1788851100.428628:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:2.0:1788851100.428639:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+16:11441:x1875746000799872:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788851100.428722:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.428740:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b9a expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.428751:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.428973:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b9a expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.428990:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b9a expref: 16 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851100.429116:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019744512:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851100.429206:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851100.434624:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851100.435451:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800000 00000100:00100000:0.0:1788851100.435463:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800000 00010000:00010000:0.0:1788851100.435510:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b9a expref: 17 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851100.435555:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:0.0:1788851100.435566:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+17:2408:x1875746000800000:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851100.435581:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851100.435588:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b9a expref: 17 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.435600:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b9a expref: 17 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.435621:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851100.435627:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bbd expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.435638:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.435678:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.435685:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.435706:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851100.436053:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+17:2408:x1875746000800000:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 488us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851100.436062:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00010000:00010000:3.0:1788851100.437454:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20618d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b9a expref: 16 pid: 6534 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851100.437478:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019744512:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851100.437501:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.437617:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.437625:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.437977:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.437991:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd9 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.438000:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.438139:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd9 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.438153:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd9 expref: 16 pid: 6536 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.438183:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019744640:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851100.438393:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86bb7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788851100.442773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.443399:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800128 00000100:00100000:3.0:1788851100.443426:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800128 00010000:00010000:3.0:1788851100.443477:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd9 expref: 17 pid: 6536 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851100.443524:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:3.0:1788851100.443536:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+17:2407:x1875746000800128:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851100.443553:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851100.443560:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd9 expref: 17 pid: 6536 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.443576:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd9 expref: 17 pid: 6536 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.443603:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:3.0:1788851100.443608:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.443618:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.443626:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.443660:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851100.444215:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+17:2407:x1875746000800128:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 678us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851100.444225:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00010000:00010000:1.0:1788851100.446095:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206258 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bd9 expref: 16 pid: 6536 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.446121:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019744640:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851100.446146:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.446156:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.446162:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851100.446363:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788851100.446490:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:1.0:1788851100.446531:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788851100.446643:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6535:1875746019744768:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788851100.446949:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851100.447669:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851100.447806:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019744768 00000100:00100000:2.0:1788851100.447813:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019744768 00000100:00100000:2.0:1788851100.447893:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788851100.447903:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6535:x1875746019744768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788851100.448009:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6535:x1875746019744768:12345-0@lo:1000:mdt00_001.0 Request processed in 108us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851100.448039:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788851100.448535:0:6535:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788851100.448542:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1788851100.448564:0:6535:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892ea7d65500, transno 4294967310 00000004:00080000:1.0:1788851100.448581:0:6535:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892ea7d67800, transno 4294967311 00000100:00100000:1.0:1788851100.448588:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6535:1875746019744768:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788851100.448742:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:1.0:1788851100.448845:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6535:1875746019744896:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788851100.448904:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851100.448934:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90913b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851100.448994:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019744896 00000100:00100000:3.0:1788851100.449000:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019744896 00000100:00100000:3.0:1788851100.449062:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788851100.449070:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6535:x1875746019744896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788851100.449202:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6535:x1875746019744896:12345-0@lo:1000:mdt00_001.0 Request processed in 133us (298us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788851100.449231:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788851100.449333:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6535:1875746019744896:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788851100.449369:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449380:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449387:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449393:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851100.449397:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449404:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449431:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:0.0:1788851100.449433:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851100.449438:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449444:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2062a5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449467:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449474:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449479:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449484:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851100.449487:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449492:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449500:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851100.449502:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851100.449509:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bbd expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449520:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bbd expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449536:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bbd expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.449565:0:6535:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bbd expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851100.449576:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019745024:192.168.204.27@tcp:105: 00000100:00100000:0.0:1788851100.449649:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a4b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851100.452430:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019745024:192.168.204.27@tcp:105: 00010000:00010000:0.0:1788851100.452461:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452473:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2061e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452507:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452519:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452531:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452543:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452549:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452567:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452574:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851100.452579:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452586:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452597:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851100.452601:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851100.452605:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452610:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b2062ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452620:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452626:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452632:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452637:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851100.452640:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452658:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452667:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851100.452668:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851100.452672:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851100.452677:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b20629e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851100.452854:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:11441:x1875746000799872:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 24215us (24407us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788851100.452864:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000020:00080000:0.0:1788851100.452871:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788851100.453411:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851100.453416:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851100.453898:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788851100.453907:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788851100.454784:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.454996:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800256 00000100:00100000:3.0:1788851100.455005:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800256 00000100:00100000:3.0:1788851100.455092:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1788851100.455102:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:11440:x1875746000800256:12345-192.168.204.27@tcp:49:lfs.0 00000100:00100000:3.0:1788851100.455230:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:11440:x1875746000800256:12345-192.168.204.27@tcp:49:lfs.0 Request processed in 129us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.455237:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:0.0:1788851100.460367:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851100.460460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.460550:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800768 00000100:00100000:1.0:1788851100.460561:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800768 00000100:00100000:1.0:1788851100.460671:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:1.0:1788851100.460682:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+19:11440:x1875746000800768:12345-192.168.204.27@tcp:58:lfs.0 00000040:00080000:1.0:1788851100.460908:0:9543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788851100.460998:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+19:11440:x1875746000800768:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 318us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851100.461007:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:3.0:1788851100.461190:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800512 00000100:00100000:3.0:1788851100.461196:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800512 00000100:00100000:3.0:1788851100.461282:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1788851100.461291:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ec1c5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:11441:x1875746000800512:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788851100.461595:0:6538:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788851100.461632:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:3.0:1788851100.461669:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.461688:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.461701:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.461709:0:6538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.461715:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.461738:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.461757:0:6538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788851100.461826:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ec1c5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+21:11441:x1875746000800512:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 536us (1474us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788851100.461846:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000020:00080000:3.0:1788851100.461852:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788851100.464928:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851100.464942:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.464954:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851100.464959:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.464968:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.464986:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:3.0:1788851100.464989:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788851100.464993:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.464999:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.465162:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851100.465165:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851100.465167:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851100.497109:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851100.497275:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800896 00000100:00100000:2.0:1788851100.497287:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800896 00000100:00100000:2.0:1788851100.497354:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:2.0:1788851100.497364:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+21:11443:x1875746000800896:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851100.497390:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851100.497411:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2062ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38bf5 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497489:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497503:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497514:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497547:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497556:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497563:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497645:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497656:0:10526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bb6 expref: 22 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497665:0:10526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497698:0:10526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bb6 expref: 22 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.497712:0:10526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bb6 expref: 22 pid: 9543 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851100.497724:0:10526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019745152:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851100.497943:0:10526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851100.502714:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851100.502822:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801152 00000100:00100000:3.0:1788851100.502848:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801152 00000100:00100000:3.0:1788851100.503042:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:3.0:1788851100.503059:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+23:6190:x1875746000801152:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788851100.503077:0:10526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019745152:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851100.503102:0:10526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851100.503284:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+24:6190:x1875746000801152:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 226us (582us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788851100.503292:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:3.0:1788851100.506088:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851100.507153:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801280 00000100:00100000:1.0:1788851100.507166:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801280 00010000:00010000:1.0:1788851100.507214:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bb6 expref: 24 pid: 9543 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.507327:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:1.0:1788851100.507338:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+24:2408:x1875746000801280:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851100.507356:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851100.507364:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bb6 expref: 24 pid: 9543 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.507401:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bb6 expref: 24 pid: 9543 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.507428:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2061da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bb6 expref: 24 pid: 9543 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.507447:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:1.0:1788851100.507453:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.507464:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.507472:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.507506:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851100.507885:0:10526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.507894:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851100.507951:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788851100.507957:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851100.507978:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.507978:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+23:2408:x1875746000801280:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 642us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851100.507987:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00010000:00010000:2.0:1788851100.507993:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508002:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508009:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508043:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508049:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851100.508053:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508061:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508071:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:2.0:1788851100.508082:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851100.508087:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508094:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2062c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508106:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508113:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508119:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508123:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851100.508126:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508132:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508138:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff892ea55ec800) 00010000:00010000:2.0:1788851100.508141:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851100.508143:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508148:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2062c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508184:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2062ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bf5 expref: 23 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508212:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bf5 expref: 22 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.508220:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:2.0:1788851100.508222:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851100.508224:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6c00, rc 0) 00000100:00100000:2.0:1788851100.508254:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+22:11443:x1875746000800896:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 10891us (11155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851100.508261:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:3.0:1788851100.600930:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019745280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851100.604978:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851100.605192:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019745280 00000100:00100000:0.0:1788851100.605203:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019745280 00000100:00100000:0.0:1788851100.605267:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788851100.605277:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019745280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851100.605366:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788851100.605444:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019745280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (4434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851100.605451:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788851100.605556:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019745280:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788851100.853819:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851101.297978:0:14330:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851101.297988:0:14330:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851101.298966:0:14330:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788851101.298974:0:14330:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788851101.492321:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851101.492332:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851101.492357:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788851101.492364:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788851101.492517:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019745408:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851101.492626:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87bee900 going to sleep for 11 seconds 00000100:00100000:3.0:1788851101.517425:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851101.517911:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019745408:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788851101.520860:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801408 00000100:00100000:0.0:1788851101.520873:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801408 00000100:00100000:0.0:1788851101.521006:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:0.0:1788851101.521036:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+22:11455:x1875746000801408:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851101.521081:0:6535:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851101.521228:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+22:11455:x1875746000801408:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 194us (3813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851101.521236:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:0.0:1788851101.529465:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851101.532367:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801664 00000100:00100000:3.0:1788851101.532383:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801664 00000100:00100000:3.0:1788851101.532450:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:3.0:1788851101.532461:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+22:11455:x1875746000801664:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851101.532483:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851101.532505:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b2062d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38bfc expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851101.532617:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851101.532634:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851101.532648:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851101.532676:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788851101.532793:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b2062d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bfc expref: 25 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851101.532824:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bfc expref: 24 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851101.532833:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:3.0:1788851101.532835:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851101.532839:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8800, rc 0) 00000100:00100000:3.0:1788851101.532916:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+24:11455:x1875746000801664:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 457us (3461us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788851101.532923:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:3.0:1788851101.538531:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851101.538682:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801920 00000100:00100000:2.0:1788851101.538693:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801920 00000100:00100000:2.0:1788851101.538771:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 144 00000100:00100000:2.0:1788851101.538977:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+24:11455:x1875746000801920:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788851101.539288:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851101.539305:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851101.539319:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851101.539538:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851101.539546:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851101.539573:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851101.539580:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851101.539585:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851101.539595:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851101.539608:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:2.0:1788851101.539611:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788851101.539616:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851101.539623:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b2062eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851101.539759:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+25:11455:x1875746000801920:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 785us (1235us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788851101.539768:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 144 00000040:00080000:1.0:1788851101.539935:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851101.539941:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851101.540472:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788851101.540481:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788851101.543584:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851101.544271:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802176 00000100:00100000:0.0:1788851101.544283:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802176 00000100:00100000:0.0:1788851101.544445:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:0.0:1788851101.544456:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+25:11455:x1875746000802176:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788851101.544693:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+26:11455:x1875746000802176:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 239us (1117us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788851101.544701:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:1.0:1788851101.554435:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851101.554579:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802304 00000100:00100000:0.0:1788851101.554592:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802304 00000100:00100000:0.0:1788851101.554658:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:0.0:1788851101.554670:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+26:2408:x1875746000802304:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851101.554686:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851101.554710:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b2062dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bfc expref: 26 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851101.554730:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851101.554735:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851101.554822:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+25:2408:x1875746000802304:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 153us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851101.554830:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00010000:00010000:3.0:1788851101.876236:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851101.876882:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851102.644536:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851102.644563:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019745536:0@lo:400:kworker.0 00000100:00100000:3.0:1788851102.644633:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851102.644686:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019745792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851102.644729:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851102.646134:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019745664:0@lo:400:kworker.0 00000100:00100000:0.0:1788851102.646191:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851102.646294:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019746048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851102.646323:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851102.646342:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851102.646348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019745920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851102.646368:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851102.646399:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019745792 00000100:00100000:0.0:1788851102.646407:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019745792 00000100:00100000:0.0:1788851102.646454:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019746048 00000100:00100000:0.0:1788851102.646457:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019746048 00000100:00100000:0.0:1788851102.646469:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019745920 00000100:00100000:0.0:1788851102.646471:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019745920 00000100:00100000:0.0:1788851102.646486:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788851102.646494:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019745792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851102.646523:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788851102.646577:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019745664 00000100:00100000:2.0:1788851102.646582:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019745664 00000100:00100000:2.0:1788851102.646614:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788851102.646620:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019745664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851102.646659:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019745664:12345-0@lo:400:kworker.0 Request processed in 39us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851102.646666:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:2.0:1788851102.646698:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788851102.646702:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851102.646731:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019745664:0@lo:400:kworker.0 00000100:00100000:2.0:1788851102.647283:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788851102.647293:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019746048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851102.647307:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788851102.647346:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019746048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851102.647352:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788851102.647367:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788851102.647373:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875746019745920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851102.647390:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851102.647413:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875746019745920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851102.647419:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788851102.647436:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019745536 00000100:00100000:2.0:1788851102.647441:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019745536 00000100:00100000:2.0:1788851102.647481:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788851102.647487:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019745536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851102.647518:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019745536:12345-0@lo:400:kworker.0 Request processed in 31us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851102.647524:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788851102.653577:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019745792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7069us (8833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851102.653592:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788851102.653915:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019745792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851102.653939:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019746304:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.653994:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019746176:0@lo:400:kworker.0 00000100:00100000:3.0:1788851102.653997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851102.654064:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851102.654088:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019746688:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851102.654139:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019746176 00000100:00100000:1.0:1788851102.654147:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019746176 00000100:00100000:1.0:1788851102.654185:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788851102.654194:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019746176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654246:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019746176:12345-0@lo:400:kworker.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851102.654251:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788851102.654293:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019746176:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654311:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019746560:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654333:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851102.654351:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019747072:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654372:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851102.654403:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019745920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851102.654429:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019746048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851102.654445:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788851102.654451:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019746432:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654474:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851102.654490:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019746944:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654508:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851102.654519:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019746304 00000100:00100000:0.0:1788851102.654523:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019746304 00000100:00100000:1.0:1788851102.654531:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019747072 00000100:00100000:1.0:1788851102.654533:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019747072 00000100:00100000:0.0:1788851102.654542:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019746688 00000100:00100000:0.0:1788851102.654544:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019746688 00000100:00100000:1.0:1788851102.654576:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788851102.654583:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019747072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654616:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019747072:12345-0@lo:400:kworker.0 Request processed in 34us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851102.654622:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019746560 00000100:00100000:1.0:1788851102.654622:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788851102.654625:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019746560 00000100:00100000:1.0:1788851102.654646:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019747072:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654667:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019745536:0@lo:400:kworker.0 00000100:00100000:0.0:1788851102.654678:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019746944 00000100:00100000:0.0:1788851102.654687:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019746944 00000100:00100000:1.0:1788851102.654701:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019746432 00000100:00100000:1.0:1788851102.654704:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019746432 00000100:00100000:0.0:1788851102.654705:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788851102.654710:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8834b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019746304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654721:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788851102.654726:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019746432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851102.654741:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8834b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019746304:12345-0@lo:400:kworker.0 Request processed in 31us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851102.654747:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788851102.654753:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019746432:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851102.654759:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788851102.654759:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788851102.654765:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019746688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654781:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019746432:0@lo:400:kworker.0 00000100:00100000:0.0:1788851102.654803:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019746688:12345-0@lo:400:kworker.0 Request processed in 38us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851102.654809:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788851102.654817:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019747200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851102.654820:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788851102.654825:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019746944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654846:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851102.654853:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019746944:12345-0@lo:400:kworker.0 Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851102.654858:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:1.0:1788851102.654866:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88282a00 x1875746019746688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851102.654876:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019746688:0@lo:400:kworker.0 00010000:00080000:0.0:1788851102.654879:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7ca1c00 x1875746019746944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851102.654887:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019746944:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654970:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019746304:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654977:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019746816:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.654998:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851102.655131:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019746816 00000100:00100000:1.0:1788851102.655135:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019746816 00000100:00100000:1.0:1788851102.655159:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788851102.655165:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019746816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.655193:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019746816:12345-0@lo:400:kworker.0 Request processed in 28us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851102.655199:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788851102.655219:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019746816:0@lo:400:kworker.0 00000100:00100000:1.0:1788851102.655242:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019747200 00000100:00100000:1.0:1788851102.655245:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019747200 00000100:00100000:1.0:1788851102.655263:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788851102.655268:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019747200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851102.655279:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851102.655307:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019747200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851102.655312:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788851102.655337:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019747200:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788851102.657647:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851102.657659:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851102.657662:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851102.658006:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788851102.658038:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019746560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851102.658135:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019746560:12345-0@lo:400:kworker.0 Request processed in 101us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851102.658143:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788851102.658201:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019746560:0@lo:400:kworker.0 00010000:00010000:0.0:1788851102.905825:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851103.475741:0:14381:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788851103.475752:0:14381:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851103.475792:0:14381:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788851103.475799:0:14381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788851103.674626:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851103.674651:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019747328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851103.674725:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851103.674807:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019747328 00000100:00100000:3.0:1788851103.674816:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019747328 00000100:00100000:3.0:1788851103.674864:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788851103.674873:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019747328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851103.674911:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851103.674961:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019747328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851103.674968:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788851103.675039:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88349500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019747328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851103.682049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851103.682322:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802560 00000100:00100000:0.0:1788851103.682336:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802560 00000100:00100000:0.0:1788851103.682449:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:0.0:1788851103.682462:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+25:11476:x1875746000802560:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851103.682495:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851103.682518:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b2062f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c03 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851103.682641:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd600/0x3e0030720b2062f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851103.682660:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd600/0x3e0030720b2062f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851103.682676:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd600/0x3e0030720b2062f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851103.682689:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788851103.682822:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b2062f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c03 expref: 28 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851103.682841:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd600/0x3e0030720b2062f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c03 expref: 27 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851103.682850:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:0.0:1788851103.682853:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788851103.682857:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bd600, rc 0) 00000100:00100000:0.0:1788851103.682919:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+27:11476:x1875746000802560:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 460us (918us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788851103.682927:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00080000:2.0:1788851103.683113:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851103.685809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851103.685887:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802688 00000100:00100000:2.0:1788851103.685906:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802688 00000100:00100000:2.0:1788851103.685967:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 146 00000100:00100000:2.0:1788851103.685977:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+27:11476:x1875746000802688:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:2.0:1788851103.686085:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.686102:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.686115:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.686163:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.686181:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.686188:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.686194:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851103.686199:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.686207:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.686220:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:2.0:1788851103.686223:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851103.686228:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.686245:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7e00/0x3e0030720b206307 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851103.686324:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+27:11476:x1875746000802688:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 349us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851103.686331:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 146 00000100:00100000:0.0:1788851103.807712:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851103.807842:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802816 00000100:00100000:2.0:1788851103.807853:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802816 00000100:00100000:2.0:1788851103.807931:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1788851103.807942:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2409:x1875746000802816:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:2.0:1788851103.807960:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851103.807979:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20630e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c0a expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851103.808008:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fb39a, atime: 0x6a9fb39a, ctime: 0x6a9fb39a, blocks: 0x8 00010000:00010000:2.0:1788851103.808072:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788851103.808076:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851103.808085:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20630e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c0a expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.808105:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20630e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c0a expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851103.808118:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7e00, rc 0) 00000100:00100000:2.0:1788851103.808187:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000802816:12345-192.168.204.27@tcp:101:cat.0 Request processed in 246us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851103.808204:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00080000:0.0:1788851103.808843:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851103.812123:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851103.812434:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802944 00000100:00100000:3.0:1788851103.812446:0:8455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802944 00002000:00100000:3.0:1788851103.812510:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff892ea5993480 x1875746000802944/t0(0) o3->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:169/0 lens 488/0 e 0 to 0 dl 1788851114 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851103.812521:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea5993480 with x1875746000802944 ext(0->4095) 00002000:00010000:3.0:1788851103.812528:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892ea5993480 00000100:00100000:3.0:1788851103.812580:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1788851103.812592:0:8455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000802944:12345-192.168.204.27@tcp:3:cat.0 00000100:00100000:3.0:1788851103.812805:0:8455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000802944:12345-192.168.204.27@tcp:3:cat.0 Request processed in 215us (690us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788851103.812813:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00002000:00100000:3.0:1788851103.812821:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff892ea5993480 x1875746000802944/t0(0) o3->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:169/0 lens 488/4536 e 0 to 0 dl 1788851114 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851103.812829:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea5993480 with x1875746000802944 ext(0->4095) 00002000:00010000:3.0:1788851103.812832:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892ea5993480 00010000:00010000:3.0:1788851103.924398:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788851104.696265:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1788851104.696285:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1788851104.948268:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851105.541004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851105.541056:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851105.541087:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851105.541107:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851105.541125:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851105.541144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851105.541184:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851105.541242:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803328 00000100:00100000:0.0:1788851105.541253:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803328 00000100:00100000:0.0:1788851105.541310:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803840 00000100:00100000:0.0:1788851105.541313:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803840 00000100:00100000:0.0:1788851105.541328:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803200 00000100:00100000:0.0:1788851105.541331:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803200 00000100:00100000:0.0:1788851105.541343:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803712 00000100:00100000:0.0:1788851105.541345:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803712 00000100:00100000:0.0:1788851105.541361:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:0.0:1788851105.541371:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000803328:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851105.541441:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000803328:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 71us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851105.541449:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 307 00000100:00100000:0.0:1788851105.541466:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 308 00000100:00100000:0.0:1788851105.541472:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000803840:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851105.541495:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000803840:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851105.541501:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 308 00000100:00100000:0.0:1788851105.541522:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 309 00000100:00100000:0.0:1788851105.541528:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+27:2409:x1875746000803200:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851105.541554:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+27:2409:x1875746000803200:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851105.541560:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 309 00000100:00100000:0.0:1788851105.541571:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 310 00000100:00100000:0.0:1788851105.541578:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000803712:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851105.541599:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000803712:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851105.541605:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 310 00000100:00100000:0.0:1788851105.541624:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803584 00000100:00100000:0.0:1788851105.541628:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803584 00000100:00100000:0.0:1788851105.541661:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803456 00000100:00100000:0.0:1788851105.541664:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803456 00000100:00100000:0.0:1788851105.541687:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:0.0:1788851105.541693:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000803584:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851105.541719:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000803584:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851105.541725:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:0.0:1788851105.541752:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:0.0:1788851105.541759:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000803456:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851105.541784:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000803456:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851105.541790:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00080000:0.0:1788851105.541827:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851105.541830:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851105.541833:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851105.541835:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851105.543430:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803072 00000100:00100000:3.0:1788851105.543442:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803072 00000100:00100000:3.0:1788851105.543495:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 388 00000100:00100000:3.0:1788851105.543503:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000803072:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851105.543560:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2409:x1875746000803072:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 57us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851105.543567:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 388 00000100:00100000:1.0:1788851105.718212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019747456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851105.718286:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851105.718505:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019747456 00000100:00100000:3.0:1788851105.718514:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019747456 00000100:00100000:3.0:1788851105.718563:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788851105.718574:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019747456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851105.718609:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788851105.718680:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019747456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851105.718696:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788851105.718838:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019747456:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788851105.727882:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788851105.727908:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1788851105.733316:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1788851105.733354:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff892e89c64e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788851105.733359:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892d88099800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff892e89c64180 00000020:00080000:2.0:1788851105.733363:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892d88099e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff892d87a3ec00 00000020:00080000:2.0:1788851105.733392:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1788851105.733457:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851105.733469:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851105.733477:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851105.733484:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9a00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851105.733488:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851105.733495:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851105.733511:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff892ea5408000) 00010000:00010000:0.0:1788851105.733514:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851105.733518:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851105.733525:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b206289 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788851105.733600:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788851105.733687:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788851105.972185:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851106.997204:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851107.764413:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019747840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851107.764466:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019747712:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.764495:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851107.764509:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851107.764614:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019747968:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.764657:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851107.764679:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8834b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019748480:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.764712:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851107.764729:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019748992:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.764748:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851107.764763:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019749504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851107.764788:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851107.764813:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788851107.764819:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8834a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019747584:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.764852:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851107.764879:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019748096:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.764899:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851107.764925:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019748608:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.764948:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851107.764964:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8834a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019749120:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.764983:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851107.764994:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019747712 00000100:00100000:1.0:1788851107.765004:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019747712 00000100:00100000:0.0:1788851107.765040:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019747840 00000100:00100000:0.0:1788851107.765045:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019747840 00000100:00100000:1.0:1788851107.765077:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019748480 00000100:00100000:1.0:1788851107.765082:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019748480 00000100:00100000:0.0:1788851107.765093:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019749504 00000100:00100000:0.0:1788851107.765098:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019749504 00000100:00100000:1.0:1788851107.765105:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019748992 00000100:00100000:1.0:1788851107.765110:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019748992 00000100:00100000:0.0:1788851107.765124:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788851107.765135:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019748096 00000100:00100000:0.0:1788851107.765138:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019747840:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851107.765140:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019748096 00002000:00000024:0.0:1788851107.765173:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788851107.765174:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788851107.765185:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019747712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.765229:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019747840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851107.765236:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019747712:12345-0@lo:400:kworker.0 Request processed in 51us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851107.765252:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788851107.765259:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788851107.765275:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788851107.765283:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788851107.765287:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019749504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851107.765296:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019748480:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788851107.765308:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851107.765350:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019749504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851107.765354:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019748480:12345-0@lo:400:kworker.0 Request processed in 60us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851107.765363:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788851107.765367:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788851107.765384:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788851107.765391:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019748992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851107.765428:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019748992:12345-0@lo:400:kworker.0 Request processed in 37us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851107.765435:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788851107.765451:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788851107.765457:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019748096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851107.765503:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019748096:12345-0@lo:400:kworker.0 Request processed in 45us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851107.765509:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788851107.765611:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019747968 00000100:00100000:0.0:1788851107.765616:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019747968 00000100:00100000:0.0:1788851107.765652:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788851107.765659:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019747968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.765705:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019747968:12345-0@lo:400:kworker.0 Request processed in 46us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851107.765710:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788851107.765740:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019747584 00000100:00100000:0.0:1788851107.765744:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019747584 00000100:00100000:0.0:1788851107.765770:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788851107.765777:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019747584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.765805:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019747584:12345-0@lo:400:kworker.0 Request processed in 29us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851107.765811:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788851107.765833:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019748608 00000100:00100000:0.0:1788851107.765837:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019748608 00000100:00100000:0.0:1788851107.765858:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019749120 00000100:00100000:0.0:1788851107.765861:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019749120 00000100:00100000:0.0:1788851107.765877:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788851107.765883:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019748608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.765920:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019748608:12345-0@lo:400:kworker.0 Request processed in 37us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851107.765927:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788851107.765939:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788851107.765945:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019749120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.765969:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019749120:12345-0@lo:400:kworker.0 Request processed in 25us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851107.765974:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788851107.765993:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851107.765996:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851107.765999:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851107.766061:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8834a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019747584:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.766075:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88349f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019748096:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.766084:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019748608:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.766092:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8834a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019749120:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.766100:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019747968:0@lo:400:kworker.0 00010000:00080000:0.0:1788851107.766111:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8834b480 x1875746019748480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851107.766121:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8834b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019748480:0@lo:400:kworker.0 00010000:00080000:0.0:1788851107.766132:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88348000 x1875746019748992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851107.766140:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019748992:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.766149:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788851107.766160:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788851107.766179:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892d8839a680, transno 4294967305 00000100:00100000:0.0:1788851107.766197:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019749504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851107.766573:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88348a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019747712:0@lo:400:kworker.0 00000100:00100000:3.0:1788851107.766584:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8834ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019748224:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.766589:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019748352:0@lo:400:kworker.0 00000100:00100000:3.0:1788851107.766631:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851107.766637:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851107.766671:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8834b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019748736:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.766675:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8834aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019748864:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.766715:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851107.766735:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019749376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851107.766742:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851107.766769:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8834bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.766769:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851107.766804:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000100:00100000:3.0:1788851107.766810:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788851107.766810:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1788851107.766836:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019747840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851107.766857:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019748224 00000100:00100000:3.0:1788851107.766861:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019748224 00000100:00100000:2.0:1788851107.766867:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019748352 00000100:00100000:2.0:1788851107.766873:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019748352 00000100:00100000:3.0:1788851107.766893:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788851107.766901:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019748224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.766917:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019748864 00000100:00100000:2.0:1788851107.766922:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019748864 00000100:00100000:3.0:1788851107.766940:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019748224:12345-0@lo:400:kworker.0 Request processed in 40us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851107.766949:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788851107.766954:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788851107.766964:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019748352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851107.766970:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019748736 00000100:00100000:3.0:1788851107.766974:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019748736 00000100:00100000:3.0:1788851107.767008:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019749248 00000100:00100000:2.0:1788851107.767030:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019748352:12345-0@lo:400:kworker.0 Request processed in 48us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851107.767037:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019749248 00000100:00100000:2.0:1788851107.767047:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788851107.767065:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788851107.767069:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788851107.767074:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019748736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.767083:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019748864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851107.767107:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019748736:12345-0@lo:400:kworker.0 Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851107.767114:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788851107.767128:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019748864:12345-0@lo:400:kworker.0 Request processed in 49us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851107.767136:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788851107.767158:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019749376 00000100:00100000:2.0:1788851107.767161:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019749376 00000100:00100000:2.0:1788851107.767182:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788851107.767187:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019749376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851107.767197:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851107.767223:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019749376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851107.767228:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788851107.767241:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851107.767266:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019748352:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.767274:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8834aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019748864:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.767285:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019749376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851107.767331:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788851107.767338:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019749248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.767367:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019749248:12345-0@lo:400:kworker.0 Request processed in 31us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851107.767373:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788851107.767442:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8834ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019748224:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.767468:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8834b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019748736:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.767481:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8834bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788851107.767887:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851107.767897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019749632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851107.767926:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851107.767995:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019749632 00000100:00100000:1.0:1788851107.768001:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019749632 00000100:00100000:1.0:1788851107.768052:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788851107.768059:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019749632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851107.768071:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788851107.768103:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019749632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851107.768108:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788851107.768298:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019749632:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788851108.022279:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851108.790398:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019749760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851108.790488:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851108.790858:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019749760 00000100:00100000:3.0:1788851108.790868:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019749760 00000100:00100000:3.0:1788851108.790922:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788851108.790931:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019749760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851108.790964:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851108.791043:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019749760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851108.791051:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788851108.791100:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019749760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851108.847332:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851108.847492:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803968 00000100:00100000:2.0:1788851108.847502:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803968 00000100:00100000:2.0:1788851108.847569:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:2.0:1788851108.847579:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+13:11120:x1875746000803968:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788851108.847702:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+13:11120:x1875746000803968:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 124us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851108.847710:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00080000:0.0:1788851108.848146:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851108.849768:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851108.849955:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804096 00000100:00100000:2.0:1788851108.849964:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804096 00000100:00100000:2.0:1788851108.850062:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00100000:2.0:1788851108.850073:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:11120:x1875746000804096:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788851108.850179:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:11120:x1875746000804096:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 107us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851108.850187:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00080000:0.0:1788851108.850766:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851108.854369:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851108.854503:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804352 00000100:00100000:0.0:1788851108.854514:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804352 00000100:00100000:0.0:1788851108.854564:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:0.0:1788851108.854574:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+13:11120:x1875746000804352:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788851108.854818:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+14:11120:x1875746000804352:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 245us (457us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788851108.854826:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00010000:00010000:0.0:1788851109.044434:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851110.070475:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851110.642181:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851110.642246:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851110.642271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851110.642291:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851110.642306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851110.642327:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851110.642349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851110.642376:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804736 00000100:00100000:1.0:1788851110.642389:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804736 00000100:00100000:1.0:1788851110.642450:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805248 00000100:00100000:1.0:1788851110.642453:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805248 00000100:00100000:1.0:1788851110.642468:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804608 00000100:00100000:1.0:1788851110.642471:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804608 00000100:00100000:1.0:1788851110.642483:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805120 00000100:00100000:1.0:1788851110.642485:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805120 00000100:00100000:1.0:1788851110.642500:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00100000:1.0:1788851110.642509:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000804736:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851110.642727:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000804736:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 218us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851110.642735:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 317 00000100:00100000:1.0:1788851110.642779:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 318 00000100:00100000:1.0:1788851110.642785:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000805248:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851110.642807:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000805248:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851110.642813:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 318 00000100:00100000:1.0:1788851110.642821:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 319 00000100:00100000:1.0:1788851110.642827:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+14:2407:x1875746000804608:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851110.642854:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+14:2407:x1875746000804608:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851110.642860:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 319 00000100:00100000:1.0:1788851110.642870:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 320 00000100:00100000:1.0:1788851110.642877:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000805120:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851110.642936:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804480 00000100:00100000:2.0:1788851110.642940:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804480 00000100:00100000:2.0:1788851110.642970:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 390 00000100:00100000:2.0:1788851110.642976:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000804480:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851110.642998:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2407:x1875746000804480:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851110.643003:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 390 00000100:00100000:2.0:1788851110.643049:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804992 00000100:00100000:2.0:1788851110.643053:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804992 00000100:00100000:2.0:1788851110.643075:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804864 00000100:00100000:2.0:1788851110.643078:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804864 00000100:00100000:2.0:1788851110.643096:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00100000:2.0:1788851110.643101:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000804992:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851110.643122:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000804992:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851110.643128:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 108 00000100:00100000:2.0:1788851110.643136:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 109 00000100:00100000:2.0:1788851110.643141:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000804864:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851110.643156:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000804864:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 16us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851110.643161:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 109 00000100:00100000:1.0:1788851110.643222:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2407:x1875746000805120:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851110.643228:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 320 00000100:00080000:1.0:1788851110.643241:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851110.643245:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851110.643247:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851110.643249:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851110.836194:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851110.836218:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019749888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851110.836291:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851110.836357:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019749888 00000100:00100000:0.0:1788851110.836365:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019749888 00000100:00100000:0.0:1788851110.836417:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788851110.836426:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019749888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851110.836472:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788851110.836520:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019749888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851110.836527:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788851110.836571:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019749888:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788851110.983118:0:14578:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:05:08 (1788851108) 00000040:00080000:0.0:1788851111.093063:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851111.095533:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851111.796324:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851111.796335:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851111.809102:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:3.0:1788851111.809118:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788851111.809743:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:2.0:1788851111.809754:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788851111.810039:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788851111.810049:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788851112.116381:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851112.411066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851112.411172:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805504 00000100:00100000:2.0:1788851112.411183:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805504 00000100:00100000:2.0:1788851112.411269:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:2.0:1788851112.411280:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+13:12193:x1875746000805504:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851112.411316:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851112.411339:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b206315 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c11 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.411411:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788851112.411566:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788851112.411980:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.411992:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412042:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412051:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412058:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412157:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b20632a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412166:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b20632a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412173:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b20632a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851112.412184:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788851112.412274:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412282:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412289:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412296:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851112.412301:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412308:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412320:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff892d81099d00) 00010000:00010000:2.0:1788851112.412323:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851112.412328:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412334:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20631c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412347:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412796:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412803:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412821:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851112.412825:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412832:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.412842:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff892e8d8f4600) 00010000:00010000:2.0:1788851112.412844:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851112.413402:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.413653:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206323 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.414176:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b206315 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c11 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.414194:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b20632a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c11 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851112.414201:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:2.0:1788851112.414204:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851112.414207:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6600, rc 0) 00000100:00100000:2.0:1788851112.414288:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+15:12193:x1875746000805504:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 3009us (3231us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788851112.414297:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:1.0:1788851112.419478:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851112.419532:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805632 00000100:00100000:2.0:1788851112.419557:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805632 00000100:00100000:2.0:1788851112.419631:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:2.0:1788851112.419641:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+15:12193:x1875746000805632:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788851112.419760:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+15:12193:x1875746000805632:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 120us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851112.419775:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:1.0:1788851112.426946:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851112.427090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851112.427208:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805760 00000100:00100000:0.0:1788851112.427218:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805760 00000100:00100000:0.0:1788851112.427288:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:0.0:1788851112.427298:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+15:2410:x1875746000805760:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851112.427314:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851112.427338:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b20632a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c11 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851112.427355:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:0.0:1788851112.427361:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851112.427425:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+14:2410:x1875746000805760:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 128us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851112.427433:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1788851112.427963:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805888 00000100:00100000:3.0:1788851112.427970:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805888 00000100:00100000:3.0:1788851112.428052:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:3.0:1788851112.428063:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:12193:x1875746000805888:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788851112.428185:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:12193:x1875746000805888:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 124us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851112.428193:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00080000:0.0:1788851112.428470:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788851112.820265:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851112.820277:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851112.820298:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:3.0:1788851112.820309:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788851112.894073:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019750016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851112.894154:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851112.894230:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851112.894240:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019750144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851112.894272:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851112.894308:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019750528:0@lo:400:kworker.0 00000100:00100000:2.0:1788851112.894346:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851112.894353:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019750272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851112.894370:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019751040:0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.894392:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851112.894415:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019750784:0@lo:400:kworker.0 00000100:00100000:2.0:1788851112.894422:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851112.894446:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851112.894459:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019751552:0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.894467:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019751296:0@lo:400:kworker.0 00000100:00100000:2.0:1788851112.894497:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851112.894502:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851112.894525:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019751808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851112.894541:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788851112.894547:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851112.894552:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019750656:0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.894573:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788851112.894581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019750400:0@lo:400:kworker.0 00000100:00100000:2.0:1788851112.894599:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851112.894650:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019750016 00000100:00100000:1.0:1788851112.894658:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019750016 00000100:00100000:1.0:1788851112.894699:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019750144 00000100:00100000:1.0:1788851112.894702:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019750144 00000100:00100000:1.0:1788851112.894714:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019750272 00000100:00100000:1.0:1788851112.894716:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019750272 00000100:00100000:1.0:1788851112.894727:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019751808 00000100:00100000:1.0:1788851112.894730:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019751808 00000100:00100000:1.0:1788851112.894746:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788851112.894754:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019750016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851112.894783:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788851112.898837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851112.898905:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019750912:0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.900173:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851112.900236:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019751424:0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.900283:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851112.900548:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019751168:0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.900644:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019750016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5888us (6488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.900656:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788851112.900698:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788851112.900710:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019750144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851112.900735:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788851112.900774:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019750144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (6503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.900780:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788851112.900792:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788851112.900799:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019750272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851112.900818:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851112.900846:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019750272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (6455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.900871:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788851112.900883:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788851112.900890:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019751808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851112.900903:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851112.900929:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019751808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (6383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.900934:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788851112.901159:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019750272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851112.901270:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019751808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851112.901818:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019750656 00000100:00100000:1.0:1788851112.901826:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019750656 00000100:00100000:1.0:1788851112.901863:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019750912 00000100:00100000:1.0:1788851112.901865:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019750912 00000100:00100000:1.0:1788851112.901876:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788851112.901882:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019750656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.901941:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019750656:12345-0@lo:400:kworker.0 Request processed in 58us (7353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.901959:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788851112.901976:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788851112.901982:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019750912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.902031:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019750912:12345-0@lo:400:kworker.0 Request processed in 50us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.902038:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788851112.902071:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851112.917710:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019751680:0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.917786:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851112.917847:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019750144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851112.917877:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019750016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851112.917903:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019750656:0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.917931:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019751552 00000100:00100000:1.0:1788851112.917937:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019751552 00000100:00100000:1.0:1788851112.920114:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019751680 00000100:00100000:1.0:1788851112.920127:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019751680 00000100:00100000:1.0:1788851112.920152:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788851112.920162:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019751552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.920247:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019751552:12345-0@lo:400:kworker.0 Request processed in 87us (25751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.920254:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788851112.920286:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788851112.920292:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019751680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.920319:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019751680:12345-0@lo:400:kworker.0 Request processed in 28us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.920324:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788851112.920377:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019750912:0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.920413:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019751680:0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.920423:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019751552:0@lo:400:kworker.0 00000100:00080000:1.0:1788851112.923109:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851112.923120:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851112.925210:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019750528 00000100:00100000:2.0:1788851112.925228:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019750528 00000100:00100000:2.0:1788851112.925295:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019751040 00000100:00100000:2.0:1788851112.925299:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019751040 00000100:00100000:2.0:1788851112.925361:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019750784 00000100:00100000:2.0:1788851112.925366:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019750784 00000100:00100000:2.0:1788851112.925385:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019751296 00000100:00100000:2.0:1788851112.925388:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019751296 00000100:00100000:2.0:1788851112.925405:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019751424 00000100:00100000:2.0:1788851112.925408:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019751424 00000100:00100000:2.0:1788851112.925426:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019751168 00000100:00100000:2.0:1788851112.925430:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019751168 00000100:00100000:2.0:1788851112.925456:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788851112.925468:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019750528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851112.925583:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019750528:12345-0@lo:400:kworker.0 Request processed in 116us (31235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851112.925601:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788851112.925633:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019750400 00000100:00100000:2.0:1788851112.925638:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788851112.925641:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019750400 00000100:00100000:2.0:1788851112.925648:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019751040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.925681:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788851112.925688:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019751040:12345-0@lo:400:kworker.0 Request processed in 42us (31283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851112.925692:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019750400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851112.925700:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788851112.925720:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788851112.925732:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019750784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.925745:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbbff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019750400:12345-0@lo:400:kworker.0 Request processed in 55us (26914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851112.925752:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788851112.925799:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788851112.925807:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019751296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.927145:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788851112.927159:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019751424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.927546:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019751424:12345-0@lo:400:kworker.0 Request processed in 390us (27262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851112.927554:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788851112.927579:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788851112.927597:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019751168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.927628:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019751168:12345-0@lo:400:kworker.0 Request processed in 43us (25556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851112.927640:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788851112.928641:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019751296:12345-0@lo:400:kworker.0 Request processed in 2829us (34134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.928662:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788851112.928718:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019750400:0@lo:400:kworker.0 00010000:00080000:1.0:1788851112.928735:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8838df80 x1875746019751424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851112.928746:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019751424:0@lo:400:kworker.0 00000100:00100000:1.0:1788851112.928758:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019751296:0@lo:400:kworker.0 00000100:00080000:3.0:1788851112.931358:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788851112.931366:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788851112.931436:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8838f800 x1875746019751168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851112.931453:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019751168:0@lo:400:kworker.0 00000100:00100000:3.0:1788851112.931468:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019750528:0@lo:400:kworker.0 00000100:00100000:3.0:1788851112.931479:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019751040:0@lo:400:kworker.0 00000100:00100000:2.0:1788851112.932893:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019750784:12345-0@lo:400:kworker.0 Request processed in 7156us (38438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851112.932920:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788851112.935195:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8838c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019750784:0@lo:400:kworker.0 00000040:00080000:0.0:1788851113.140710:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851113.141431:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851113.918153:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019751936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851113.918240:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851113.918312:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019751936 00000100:00100000:3.0:1788851113.918322:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019751936 00000100:00100000:3.0:1788851113.918391:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788851113.918402:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019751936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851113.918439:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851113.918498:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019751936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851113.918506:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788851113.920316:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019751936:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788851114.164477:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851114.863960:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851114.864095:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806016 00000100:00100000:2.0:1788851114.864115:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806016 00000100:00100000:2.0:1788851114.864185:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00100000:2.0:1788851114.864197:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+14:12235:x1875746000806016:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851114.864219:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851114.864241:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c18 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864315:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864332:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864344:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864358:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864366:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864371:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864415:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864422:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864429:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864440:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851114.864444:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864451:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864464:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea5408700) 00010000:00010000:2.0:1788851114.864467:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851114.864472:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864479:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b20633f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864513:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864519:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864525:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864530:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851114.864533:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864539:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864568:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff892e8d8f4600) 00010000:00010000:2.0:1788851114.864570:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851114.864694:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864703:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206346 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864736:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206338 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c18 expref: 15 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864749:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea5408700) 00010000:00010000:2.0:1788851114.864752:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851114.864755:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c18 expref: 15 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.864764:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6800, rc 0) 00000100:00100000:2.0:1788851114.864831:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+14:12235:x1875746000806016:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 637us (881us total) trans 0 rc 301/301 00000100:00100000:2.0:1788851114.864839:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00080000:3.0:1788851114.865311:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851114.870812:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851114.870935:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806272 00000100:00100000:2.0:1788851114.870945:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806272 00000100:00100000:2.0:1788851114.871007:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 153 00000100:00100000:2.0:1788851114.871034:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+14:12235:x1875746000806272:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:2.0:1788851114.871094:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851114.871123:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b205c9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a43 expref: 14 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.871157:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ea5408700) 00010000:00010000:2.0:1788851114.871169:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851114.871230:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.871245:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.871255:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.871267:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.871274:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.871280:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872218:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872232:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872241:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851114.872257:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9dc95c8 reply state 0000000010e65e09 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872280:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872287:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851114.872290:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851114.872293:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788851114.872298:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788851114.872305:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872312:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872318:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872324:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851114.872328:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872335:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872345:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8d8f4c00) 00010000:00010000:2.0:1788851114.872347:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851114.872351:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872356:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20634d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851114.872385:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9dc95c8 reply state 0000000010e65e09 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872394:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.872399:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff892e8d8f4300) 00010000:00010000:2.0:1788851114.872402:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851114.872404:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788851114.872773:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+15:12235:x1875746000806272:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 1738us (1969us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788851114.872783:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 153 00000100:00100000:3.0:1788851115.060910:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851115.061095:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806400 00000100:00100000:1.0:1788851115.061106:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806400 00000100:00100000:1.0:1788851115.061162:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 154 00000100:00100000:1.0:1788851115.061172:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+15:12243:x1875746000806400:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:1.0:1788851115.061200:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851115.061227:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206362 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c1f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.061297:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206369 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.061311:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206369 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.061324:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206369 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851115.061372:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788851115.061376:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851115.061414:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206369 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.061439:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206362 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c1f expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.061455:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206369 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c1f expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.061463:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8dc9b500) 00010000:00010000:1.0:1788851115.061466:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851115.061469:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94200, rc 0) 00000100:00100000:1.0:1788851115.061541:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+16:12243:x1875746000806400:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 370us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.061560:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 154 00000100:00100000:3.0:1788851115.122531:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.122838:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806528 00000100:00100000:2.0:1788851115.122850:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806528 00000100:00100000:2.0:1788851115.122919:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 155 00000100:00100000:2.0:1788851115.122928:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+16:12249:x1875746000806528:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1788851115.122951:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851115.122975:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b206370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c26 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123089:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123106:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123119:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123149:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123156:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123163:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123243:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206385 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123252:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123259:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851115.123295:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788851115.123299:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851115.123319:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123331:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123337:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123343:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123359:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851115.123363:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123371:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123384:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8dc9b500) 00010000:00010000:2.0:1788851115.123386:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851115.123391:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123397:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123409:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123414:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123419:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123425:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851115.123428:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123434:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123452:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff892e8d8f4300) 00010000:00010000:2.0:1788851115.123454:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851115.123458:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123463:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b20637e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123507:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b206370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c26 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123522:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206385 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c26 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.123528:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851115.123531:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788851115.123533:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7600, rc 0) 00000100:00100000:2.0:1788851115.123903:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+17:12249:x1875746000806528:12345-192.168.204.27@tcp:101:bash.0 Request processed in 974us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851115.123912:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 155 00000100:00100000:1.0:1788851115.127298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.127392:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806784 00000100:00100000:2.0:1788851115.127404:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806784 00000100:00100000:2.0:1788851115.127569:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:2.0:1788851115.127590:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+17:12249:x1875746000806784:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1788851115.127612:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851115.127634:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20638c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c2d expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.127773:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.127788:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.127799:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.127817:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.127824:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.127832:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851115.128272:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788851115.128413:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128422:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128430:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128461:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128853:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128861:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128868:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851115.128873:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128881:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128894:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851115.128898:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851115.128903:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128910:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206393 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851115.128928:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c4fad0f reply state 000000002a267868 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128940:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.128946:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8d8f4c00) 00010000:00010000:2.0:1788851115.128949:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851115.128951:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788851115.128989:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20638c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c2d expref: 20 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.129041:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c2d expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.129048:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8d8f4600) 00010000:00010000:2.0:1788851115.129051:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851115.129053:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2155e00, rc 0) 00000100:00100000:2.0:1788851115.129174:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+20:12249:x1875746000806784:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1594us (1883us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788851115.129185:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 156 00000100:00100000:0.0:1788851115.136850:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851115.136960:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806912 00000100:00100000:1.0:1788851115.136970:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806912 00000100:00100000:1.0:1788851115.137164:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:1.0:1788851115.137174:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2407:x1875746000806912:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1788851115.137192:0:8625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851115.137214:0:8625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c34 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851115.137241:0:8625:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851115.137262:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788851115.137266:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851115.137275:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c34 expref: 6 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.137312:0:8625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c34 expref: 6 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.137326:0:8625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95000, rc 0) 00000100:00100000:1.0:1788851115.137392:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000806912:12345-192.168.204.27@tcp:101:bash.0 Request processed in 219us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.137398:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00080000:3.0:1788851115.139987:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851115.140421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.140512:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807040 00000100:00100000:3.0:1788851115.140525:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807040 00000100:00100000:3.0:1788851115.140722:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:3.0:1788851115.140735:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8813d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:12249:x1875746000807040:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851115.140757:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851115.140783:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c3b expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.140821:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c34 expref: 7 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.140830:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851115.140834:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851115.140839:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.140876:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c34 expref: 7 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.140890:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c34 expref: 7 pid: 8625 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851115.140930:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea591d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8447:1875746019752064:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851115.141079:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87a41600 going to sleep for 11 seconds 00000100:00100000:0.0:1788851115.144770:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.144898:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807168 00000100:00100000:2.0:1788851115.144908:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807168 00010000:00010000:2.0:1788851115.144952:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c34 expref: 8 pid: 8625 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851115.144996:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:2.0:1788851115.145005:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000807168:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851115.145055:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851115.145080:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c34 expref: 8 pid: 8625 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.145095:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c34 expref: 8 pid: 8625 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.145124:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851115.145145:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851115.145156:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.145167:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.145208:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851115.145223:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6521:1875746019752192:192.168.204.27@tcp:105: 00000100:00100000:2.0:1788851115.145301:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e85d58540 going to sleep for 11 seconds 00010000:00010000:3.0:1788851115.147794:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2063af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c34 expref: 8 pid: 8625 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851115.147822:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea591d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8447:1875746019752064:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851115.147864:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.147882:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8c00, rc 0) 00000100:00100000:3.0:1788851115.148382:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6521:1875746019752192:192.168.204.27@tcp:105: 00010000:00010000:3.0:1788851115.148396:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851115.148452:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000807168:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 3447us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851115.148462:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:2.0:1788851115.149869:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8813d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:12249:x1875746000807040:12345-192.168.204.27@tcp:101:bash.0 Request processed in 9125us (9444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851115.149880:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:1.0:1788851115.153008:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.153217:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807424 00000100:00100000:3.0:1788851115.153230:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807424 00000100:00100000:3.0:1788851115.153343:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:3.0:1788851115.153355:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+20:12249:x1875746000807424:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1788851115.153951:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+21:12249:x1875746000807424:12345-192.168.204.27@tcp:35:bash.0 Request processed in 596us (950us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788851115.153961:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00010000:00010000:0.0:1788851115.188330:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851115.233126:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.233264:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807680 00000100:00100000:3.0:1788851115.233293:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807680 00000100:00100000:3.0:1788851115.233364:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:3.0:1788851115.233375:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+21:12259:x1875746000807680:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851115.233402:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851115.233423:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2063bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c42 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851115.233556:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788851115.233686:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2063bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c42 expref: 23 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.233699:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8dc9b500) 00010000:00010000:3.0:1788851115.233702:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851115.233713:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2063bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c42 expref: 23 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.233728:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9e00, rc 0) 00000100:00100000:3.0:1788851115.233794:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+22:12259:x1875746000807680:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 421us (679us total) trans 4294967422 rc 301/301 00000100:00100000:3.0:1788851115.233801:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 157 00000100:00100000:0.0:1788851115.237510:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.237613:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807936 00000100:00100000:2.0:1788851115.237623:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807936 00000100:00100000:2.0:1788851115.237688:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:2.0:1788851115.237701:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+22:12259:x1875746000807936:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1788851115.237946:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+23:12259:x1875746000807936:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 247us (445us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788851115.237954:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:1.0:1788851115.305690:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.305895:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808064 00000100:00100000:3.0:1788851115.305906:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808064 00000100:00100000:3.0:1788851115.305968:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:3.0:1788851115.305979:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+23:12265:x1875746000808064:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851115.306002:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851115.306061:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2063cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c49 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.306154:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2063d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.306170:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2063d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.306183:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2063d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851115.306233:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788851115.306237:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851115.306259:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2063d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.306288:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2063cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c49 expref: 25 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.306310:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2063d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c49 expref: 24 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.306318:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:3.0:1788851115.306321:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851115.306325:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9200, rc 0) 00000100:00100000:3.0:1788851115.306383:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+24:12265:x1875746000808064:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 405us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851115.306390:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 158 00000100:00100000:1.0:1788851115.310966:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.311319:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808320 00000100:00100000:2.0:1788851115.311331:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808320 00000100:00100000:2.0:1788851115.311395:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:2.0:1788851115.311406:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+24:12265:x1875746000808320:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851115.311447:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851115.311469:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154e00/0x3e0030720b2063d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c50 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.311621:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2063e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.311635:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2063e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.311655:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2063e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851115.311667:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788851115.311779:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154e00/0x3e0030720b2063d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c50 expref: 27 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.311799:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2063e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c50 expref: 26 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.311807:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8d8f4600) 00010000:00010000:2.0:1788851115.311810:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851115.311813:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6e00, rc 0) 00000100:00100000:2.0:1788851115.311883:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+26:12265:x1875746000808320:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 479us (928us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788851115.311891:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:0.0:1788851115.315887:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851115.315938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.316046:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808576 00000100:00100000:2.0:1788851115.316057:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808576 00000100:00100000:2.0:1788851115.316123:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:2.0:1788851115.316150:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+26:12265:x1875746000808576:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851115.316177:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851115.316201:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2063ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c57 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.316313:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2063f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.316328:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2063f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.316340:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2063f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851115.316351:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788851115.316457:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2063ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c57 expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.316490:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2063f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c57 expref: 28 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.316498:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8d8f4600) 00010000:00010000:2.0:1788851115.316501:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788851115.316505:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6200, rc 0) 00000100:00100000:2.0:1788851115.316586:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+28:12265:x1875746000808576:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 439us (647us total) trans 4294967425 rc 0/0 00000100:00100000:2.0:1788851115.316594:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:1.0:1788851115.317140:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808704 00000100:00100000:1.0:1788851115.317148:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808704 00000100:00100000:1.0:1788851115.317196:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1788851115.317205:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+28:2409:x1875746000808704:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851115.317218:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851115.317237:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2063e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c50 expref: 28 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.317251:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8d8f4600) 00010000:00010000:1.0:1788851115.317255:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851115.317294:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+27:2409:x1875746000808704:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 90us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.317301:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1788851115.325227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851115.325325:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808832 00000100:00100000:1.0:1788851115.325337:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808832 00000100:00100000:1.0:1788851115.325391:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:1.0:1788851115.325401:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000808832:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:1.0:1788851115.325458:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.325488:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.325497:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851115.325502:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851115.325507:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.325556:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.325580:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 6 pid: 8447 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851115.325593:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1875746019752320:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851115.325701:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea54436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851115.328734:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851115.328885:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808960 00000100:00100000:0.0:1788851115.328895:0:8455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808960 00002000:00100000:0.0:1788851115.328943:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff892ea591d180 x1875746000808960/t0(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:181/0 lens 504/0 e 0 to 0 dl 1788851126 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788851115.328956:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea591d180 with x1875746000808960 ext(0->12) 00010000:00010000:0.0:1788851115.328965:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 7 pid: 8447 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851115.328981:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 7 pid: 8447 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851115.328989:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff892ea591d180 00000100:00100000:0.0:1788851115.329058:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1788851115.329068:0:8455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea591d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000808960:12345-192.168.204.27@tcp:4:lfs.0 00000100:00100000:1.0:1788851115.329620:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1875746019752320:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851115.329656:0:8625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851115.330370:0:8455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea591d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+9:2408:x1875746000808960:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 1300us (1642us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788851115.330390:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00002000:00100000:0.0:1788851115.330400:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff892ea591d180 x1875746000808960/t4294967306(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:181/0 lens 504/448 e 0 to 0 dl 1788851126 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788851115.330408:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea591d180 with x1875746000808960 ext(0->12) 00010000:00010000:0.0:1788851115.330416:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 9 pid: 8447 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851115.330428:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 9 pid: 8447 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851115.330435:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff892ea591d180 00000100:00100000:0.0:1788851115.333597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.333780:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809088 00000100:00100000:2.0:1788851115.333789:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809088 00010000:00010000:2.0:1788851115.333841:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 9 pid: 8447 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851115.333885:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:2.0:1788851115.333896:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+9:2410:x1875746000809088:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851115.333911:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788851115.333928:0:6520:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788851115.333931:0:6520:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788851114 00002000:00010000:2.0:1788851115.333933:0:6520:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788851114 00002000:00010000:2.0:1788851115.333935:0:6520:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788851114 00002000:00010000:2.0:1788851115.333937:0:6520:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788851115.333943:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 9 pid: 8447 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.333955:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 9 pid: 8447 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.333976:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d124f293/0x3e0030720b2063b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c3b expref: 9 pid: 8447 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.333993:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851115.333997:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851115.334003:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.334160:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.334208:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851115.334261:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+8:2410:x1875746000809088:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 367us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851115.334269:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 81 00010000:00010000:3.0:1788851115.334328:0:8625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.334344:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.334364:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.334372:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.334381:0:8625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.334388:0:8625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851115.334392:0:8625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.334399:0:8625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.334412:0:8625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.334419:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b206403 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851115.334496:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000808832:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 9094us (9278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851115.334507:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1788851115.337924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.338006:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809344 00000100:00100000:2.0:1788851115.338058:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809344 00000100:00100000:2.0:1788851115.338111:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:2.0:1788851115.338121:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbb2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+27:12265:x1875746000809344:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:2.0:1788851115.338199:0:6538:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2063f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c57 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851115.338455:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788851115.338509:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1788851115.339224:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1788851115.339269:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.339285:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c2d expref: 31 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.339293:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.339330:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c2d expref: 31 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.339344:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c2d expref: 31 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851115.339370:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6538:1875746019752448:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851115.339449:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851115.343878:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.343987:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6538:1875746019752448:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851115.344047:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851115.344122:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809472 00000100:00100000:1.0:1788851115.344129:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809472 00010000:00010000:1.0:1788851115.344169:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c2d expref: 32 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851115.344202:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 82 00000100:00100000:1.0:1788851115.344212:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90055500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+32:2408:x1875746000809472:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851115.344229:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851115.344237:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c2d expref: 32 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.344249:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c2d expref: 32 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.344271:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b2063a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c2d expref: 32 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.344287:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8d8f4600) 00010000:00010000:1.0:1788851115.344292:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.344302:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.344310:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.344364:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851115.344414:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90055500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+31:2408:x1875746000809472:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 204us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.344422:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 82 00010000:00010000:2.0:1788851115.344483:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.344491:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851115.344613:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1788851115.344724:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788851115.344814:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6538:1875746019752576:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788851115.344873:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851115.344918:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccd600 going to sleep for 11 seconds 00000100:00100000:1.0:1788851115.345839:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019752576 00000100:00100000:1.0:1788851115.345854:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019752576 00000100:00100000:1.0:1788851115.345919:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788851115.345927:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6538:x1875746019752576:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788851115.346042:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6538:x1875746019752576:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.346049:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1788851115.346172:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851115.346310:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6538:1875746019752576:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788851115.346457:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:2.0:1788851115.346529:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6538:1875746019752704:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788851115.346582:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851115.346605:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788851115.346978:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019752704 00000100:00100000:1.0:1788851115.346984:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019752704 00000100:00100000:1.0:1788851115.347059:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788851115.347068:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6538:x1875746019752704:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788851115.347188:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6538:x1875746019752704:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (605us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788851115.347196:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788851115.347514:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8813d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6538:1875746019752704:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788851115.347585:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788851115.347625:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.347664:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.347672:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.347678:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851115.347683:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.347691:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.347707:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8d8f4600) 00010000:00010000:2.0:1788851115.347711:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788851115.347717:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.347723:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20640a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851115.347825:0:6538:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788851115.347899:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788851115.347912:0:6538:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 449406899064ns, next at 450406896226ns, rc = 0 00000001:00080000:2.0:1788851115.347919:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:2.0:1788851115.347943:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8d8f4600) 00010000:00010000:2.0:1788851115.347946:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788851115.347954:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2063f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c57 expref: 35 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851115.348112:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbb2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+34:12265:x1875746000809344:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 9992us (10199us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788851115.348121:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000020:00080000:2.0:1788851115.348125:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788851115.351551:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851115.351642:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809600 00000100:00100000:1.0:1788851115.351663:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809600 00000100:00100000:1.0:1788851115.351724:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:1.0:1788851115.351735:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+34:12265:x1875746000809600:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851115.351761:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851115.351784:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b206411 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c5e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.351865:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b206411 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c5e expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.351880:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b206411 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c5e expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.351897:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851115.351900:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851115.351904:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95a00, rc 0) 00000100:00100000:1.0:1788851115.351964:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+35:12265:x1875746000809600:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 231us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.351971:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:0.0:1788851115.355659:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.355736:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809856 00000100:00100000:3.0:1788851115.355747:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809856 00000100:00100000:3.0:1788851115.355811:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:3.0:1788851115.355822:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+35:12265:x1875746000809856:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851115.356104:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+36:12265:x1875746000809856:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 283us (454us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788851115.356113:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:3.0:1788851115.437938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.438038:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810112 00000100:00100000:2.0:1788851115.438048:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810112 00000100:00100000:2.0:1788851115.438109:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:2.0:1788851115.438118:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+36:12275:x1875746000810112:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851115.438143:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851115.438162:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b206418 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c65 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851115.438283:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788851115.438391:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b206418 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c65 expref: 38 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.438405:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8dc9b500) 00010000:00010000:2.0:1788851115.438408:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851115.438414:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b206418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c65 expref: 38 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.438429:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6200, rc 0) 00000100:00100000:2.0:1788851115.438522:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+37:12275:x1875746000810112:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 404us (593us total) trans 4294967436 rc 301/301 00000100:00100000:2.0:1788851115.438530:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:0.0:1788851115.442867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.443432:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810240 00000100:00100000:3.0:1788851115.443444:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810240 00000100:00100000:3.0:1788851115.443516:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:3.0:1788851115.443526:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+37:12275:x1875746000810240:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:3.0:1788851115.443614:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443632:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443643:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443680:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443688:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443695:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443772:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443781:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443788:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851115.443838:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443852:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443859:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443867:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443873:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851115.443878:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443892:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443904:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:3.0:1788851115.443907:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851115.443912:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443917:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b206426 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443933:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443938:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443942:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443947:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851115.443949:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443955:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443961:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8d8f4c00) 00010000:00010000:3.0:1788851115.443963:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851115.443965:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443980:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20642d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443989:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.443994:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.444000:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.444004:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851115.444007:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.444181:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.444190:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851115.444192:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851115.444195:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.444201:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206434 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851115.444274:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+37:12275:x1875746000810240:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 748us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851115.444282:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:1.0:1788851115.447096:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.447336:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810496 00000100:00100000:3.0:1788851115.447347:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810496 00000100:00100000:3.0:1788851115.447407:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:3.0:1788851115.447418:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+37:12275:x1875746000810496:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851115.447712:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+38:12275:x1875746000810496:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 294us (623us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788851115.447719:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:0.0:1788851115.482313:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.482419:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810752 00000100:00100000:2.0:1788851115.482431:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810752 00000100:00100000:2.0:1788851115.482509:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:2.0:1788851115.482522:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+38:12278:x1875746000810752:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851115.482818:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851115.482842:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20643b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c6c expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.482925:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.482940:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.482953:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.482963:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.482970:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.482977:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483118:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483128:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483155:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851115.483165:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788851115.483253:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483261:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483267:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483273:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851115.483278:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483286:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483298:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851115.483301:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851115.483306:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483312:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206442 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483324:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483330:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483342:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483347:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851115.483350:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483356:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483364:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8d8f4c00) 00010000:00010000:2.0:1788851115.483366:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851115.483369:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483375:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206449 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483415:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20643b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c6c expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483430:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c6c expref: 40 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.483437:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851115.483440:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851115.483442:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6800, rc 0) 00000100:00100000:2.0:1788851115.483528:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+40:12278:x1875746000810752:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1007us (1224us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788851115.483554:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:0.0:1788851115.486915:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.487004:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810880 00000100:00100000:2.0:1788851115.487034:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810880 00000100:00100000:2.0:1788851115.487096:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:2.0:1788851115.487107:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+40:12278:x1875746000810880:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:2.0:1788851115.487179:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.487199:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.487211:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.487247:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.487255:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.487261:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.487267:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851115.487272:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.487279:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.487291:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851115.487309:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851115.487314:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.487321:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b20645e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851115.487399:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+40:12278:x1875746000810880:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 294us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851115.487407:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:1.0:1788851115.490737:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.490920:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811136 00000100:00100000:3.0:1788851115.490931:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811136 00000100:00100000:3.0:1788851115.490993:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:3.0:1788851115.491003:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+40:12278:x1875746000811136:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851115.491284:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+41:12278:x1875746000811136:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 282us (557us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788851115.491292:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1788851115.727365:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.727446:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811392 00000100:00100000:3.0:1788851115.727457:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811392 00000100:00100000:3.0:1788851115.727543:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:3.0:1788851115.727554:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+41:12309:x1875746000811392:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:3.0:1788851115.727588:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851115.727609:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206465 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c73 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.727729:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20646c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.727744:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20646c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.727772:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20646c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851115.727785:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788851115.731895:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206465 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c73 expref: 44 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.731932:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20646c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c73 expref: 43 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851115.731940:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851115.731943:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851115.731947:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9000, rc 0) 00000100:00100000:3.0:1788851115.732054:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+43:12309:x1875746000811392:12345-192.168.204.27@tcp:101:cat.0 Request processed in 4500us (4696us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788851115.732063:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:3.0:1788851115.735997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851115.736081:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.736196:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811776 00000100:00100000:2.0:1788851115.736207:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811776 00000100:00100000:2.0:1788851115.736268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1788851115.736279:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+43:2409:x1875746000811776:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851115.736293:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851115.736318:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20646c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c73 expref: 43 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.736342:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851115.736346:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851115.736401:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+42:2409:x1875746000811776:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 124us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851115.736409:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1788851115.737494:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811648 00000100:00100000:1.0:1788851115.737506:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811648 00000100:00100000:1.0:1788851115.737573:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:1.0:1788851115.737581:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+42:12309:x1875746000811648:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:1.0:1788851115.738389:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+43:12309:x1875746000811648:12345-192.168.204.27@tcp:35:cat.0 Request processed in 804us (2397us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788851115.738397:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:0.0:1788851115.770052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851115.770100:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851115.770133:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851115.770153:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851115.770174:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851115.770200:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851115.770281:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812160 00000100:00100000:1.0:1788851115.770291:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812160 00000100:00100000:1.0:1788851115.770359:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812288 00000100:00100000:1.0:1788851115.770363:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812288 00000100:00100000:1.0:1788851115.770385:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 112 00000100:00100000:1.0:1788851115.770410:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000812160:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851115.770498:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+6:2410:x1875746000812160:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.770505:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 112 00000100:00100000:1.0:1788851115.770523:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 113 00000100:00100000:1.0:1788851115.770529:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000812288:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851115.770576:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000812288:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 47us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.770583:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 113 00000100:00100000:1.0:1788851115.770609:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812032 00000100:00100000:1.0:1788851115.770612:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812032 00000100:00100000:1.0:1788851115.770639:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812416 00000100:00100000:1.0:1788851115.770641:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812416 00000100:00100000:1.0:1788851115.770659:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812544 00000100:00100000:1.0:1788851115.770662:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812544 00000100:00100000:1.0:1788851115.770676:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 327 00000100:00100000:1.0:1788851115.770682:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000812032:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851115.770708:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2409:x1875746000812032:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.770714:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 327 00000100:00100000:1.0:1788851115.770725:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 328 00000100:00100000:1.0:1788851115.770731:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000812416:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851115.770752:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000812416:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.770757:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 328 00000100:00100000:1.0:1788851115.770777:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 329 00000100:00100000:1.0:1788851115.770783:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000812544:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851115.770807:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2409:x1875746000812544:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.770813:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 329 00000100:00100000:3.0:1788851115.771140:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811904 00000100:00100000:3.0:1788851115.771146:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811904 00000100:00100000:3.0:1788851115.771188:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 392 00000100:00100000:3.0:1788851115.771197:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000811904:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851115.771239:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e92de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000811904:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 43us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851115.771245:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 392 00000100:00080000:0.0:1788851115.772038:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851115.772045:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851115.772049:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851115.800339:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851115.800435:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812800 00000100:00100000:1.0:1788851115.800446:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812800 00000100:00100000:1.0:1788851115.800522:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:1.0:1788851115.800542:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+43:12315:x1875746000812800:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:1.0:1788851115.800577:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851115.800580:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788851115.800607:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2063d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c49 expref: 43 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.800630:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:1.0:1788851115.800635:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851115.800897:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b20647a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c7a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.801144:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.801160:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c6c expref: 43 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.801168:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.801220:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c6c expref: 43 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.801236:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c6c expref: 43 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851115.801252:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019752832:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851115.801354:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443480 going to sleep for 11 seconds 00000100:00100000:2.0:1788851115.805043:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851115.805126:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812928 00000100:00100000:0.0:1788851115.805136:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812928 00010000:00010000:0.0:1788851115.805176:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c6c expref: 44 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851115.805223:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 83 00000100:00100000:0.0:1788851115.805233:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+44:2407:x1875746000812928:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851115.805249:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851115.805256:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c6c expref: 44 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851115.805270:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c6c expref: 44 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851115.805292:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:0.0:1788851115.805297:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851115.805307:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851115.805315:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851115.805337:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851115.805393:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+44:2407:x1875746000812928:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 160us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851115.805400:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 83 00010000:00010000:1.0:1788851115.805619:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c6c expref: 43 pid: 6536 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851115.805635:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019752832:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851115.805655:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.805664:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.805671:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851115.805688:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788851115.805816:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b20647a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c7a expref: 44 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.805831:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c7a expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.805850:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851115.805853:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788851115.805856:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94c00, rc 0) 00000100:00100000:1.0:1788851115.805884:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+43:12315:x1875746000812800:12345-192.168.204.27@tcp:101:dd.0 Request processed in 5353us (5555us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788851115.805890:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:2.0:1788851115.808728:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851115.808804:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813056 00000100:00100000:1.0:1788851115.808813:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813056 00000100:00100000:1.0:1788851115.808870:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:1.0:1788851115.808880:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+43:12315:x1875746000813056:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:1.0:1788851115.808903:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851115.808922:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20648f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c81 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.808954:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.808969:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.808979:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.809123:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20648f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c81 expref: 45 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.809142:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c81 expref: 44 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851115.809158:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851115.809161:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788851115.809164:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95e00, rc 0) 00000100:00100000:1.0:1788851115.809236:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+44:12315:x1875746000813056:12345-192.168.204.27@tcp:101:dd.0 Request processed in 356us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851115.809243:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:3.0:1788851115.812084:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851115.812214:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813312 00000100:00100000:2.0:1788851115.812225:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813312 00000100:00100000:2.0:1788851115.812284:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:2.0:1788851115.812295:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+44:12315:x1875746000813312:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:2.0:1788851115.812581:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.812600:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.812614:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851115.812792:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788851115.812820:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d87a491d reply state 000000003dac7ac8 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.812833:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851115.812840:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851115.812843:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851115.812847:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851115.812977:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+47:12315:x1875746000813312:12345-192.168.204.27@tcp:36:dd.0 Request processed in 682us (900us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788851115.812984:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 169 00000020:00080000:2.0:1788851115.812989:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788851115.956297:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851115.956321:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d879c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019752960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851115.956393:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851115.956591:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019752960 00000100:00100000:0.0:1788851115.956602:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019752960 00000100:00100000:0.0:1788851115.956677:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788851115.956686:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019752960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851115.956722:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788851115.956954:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019752960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 268us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851115.956961:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788851115.957072:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d879c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019752960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851116.048095:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851116.048257:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813440 00000100:00100000:1.0:1788851116.048268:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813440 00000100:00100000:1.0:1788851116.048349:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 170 00000100:00100000:1.0:1788851116.048359:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+47:12329:x1875746000813440:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:1.0:1788851116.048383:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851116.048404:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b2064a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c88 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.048479:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.048493:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.048505:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.048541:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.048556:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.048563:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.048636:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788851116.049067:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788851116.049131:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c7a expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.049145:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.049183:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c7a expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.049197:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c7a expref: 48 pid: 6535 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851116.049211:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ba9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019753088:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851116.049423:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443480 going to sleep for 11 seconds 00000100:00100000:2.0:1788851116.052426:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ba9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019753088:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851116.052544:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851116.054341:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.054662:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813696 00000100:00100000:2.0:1788851116.054671:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813696 00000100:00100000:1.0:1788851116.054910:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1788851116.054923:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+49:6189:x1875746000813696:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788851116.055345:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+50:6189:x1875746000813696:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 424us (1011us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1788851116.055353:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1788851116.058359:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.058458:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813824 00000100:00100000:2.0:1788851116.058479:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813824 00010000:00010000:2.0:1788851116.058566:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c7a expref: 50 pid: 6535 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851116.058620:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 84 00000100:00100000:2.0:1788851116.058630:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+50:2408:x1875746000813824:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851116.058647:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851116.058654:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c7a expref: 50 pid: 6535 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.058667:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c7a expref: 50 pid: 6535 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.058689:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206481 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c7a expref: 50 pid: 6535 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.058719:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851116.058724:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.058901:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.058910:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.058944:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851116.059003:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+49:2408:x1875746000813824:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 373us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851116.059051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 84 00010000:00010000:1.0:1788851116.059589:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059599:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851116.059653:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788851116.059657:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851116.059678:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059692:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059714:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059720:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059727:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059860:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851116.059864:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059885:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059896:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:1.0:1788851116.059900:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851116.059905:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059911:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059922:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059928:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059935:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059940:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851116.059942:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059947:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059954:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8d8f4c00) 00010000:00010000:1.0:1788851116.059956:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851116.059959:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.059974:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.060009:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b2064a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c88 expref: 49 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.060063:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c88 expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.060071:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851116.060073:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851116.060075:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030800, rc 0) 00000100:00100000:1.0:1788851116.060181:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+48:12329:x1875746000813440:12345-192.168.204.27@tcp:101:stat.0 Request processed in 11822us (12097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851116.060188:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 170 00000100:00100000:1.0:1788851116.142640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.142767:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814080 00000100:00100000:2.0:1788851116.142777:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814080 00000100:00100000:2.0:1788851116.142839:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 171 00000100:00100000:2.0:1788851116.142849:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+48:12335:x1875746000814080:12345-192.168.204.27@tcp:36:truncate.0 00010000:00010000:2.0:1788851116.142908:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851116.142937:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2064b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c88 expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.142957:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851116.142962:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851116.143192:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.143208:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.143219:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851116.143264:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:2.0:1788851116.143284:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0153eb9 reply state 00000000096c1fd1 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.143295:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.143302:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851116.143305:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851116.143307:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851116.143393:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+50:12335:x1875746000814080:12345-192.168.204.27@tcp:36:truncate.0 Request processed in 546us (763us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788851116.143416:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 171 00000020:00080000:2.0:1788851116.143421:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788851116.212212:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851116.286049:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.286441:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814208 00000100:00100000:2.0:1788851116.286467:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814208 00000100:00100000:2.0:1788851116.286542:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 172 00000100:00100000:2.0:1788851116.286557:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+50:12349:x1875746000814208:12345-192.168.204.27@tcp:101:stat.0 00010000:00010000:2.0:1788851116.286585:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851116.286608:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2064c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c8f expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.286688:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.286919:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.286932:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.286946:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.286954:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.286960:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287075:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287105:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287113:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851116.287158:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788851116.287163:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851116.287189:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287202:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287210:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287216:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287222:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287228:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.287232:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287241:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287254:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851116.287265:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.287271:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287277:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2064ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287293:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287299:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287305:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287310:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.287312:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287318:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287326:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8d8f4c00) 00010000:00010000:2.0:1788851116.287328:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.287331:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287336:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2064d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287365:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2064c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c8f expref: 52 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287392:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c8f expref: 51 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.287400:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851116.287403:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851116.287405:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95000, rc 0) 00000100:00100000:2.0:1788851116.287818:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+51:12349:x1875746000814208:12345-192.168.204.27@tcp:101:stat.0 Request processed in 1261us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851116.287827:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 172 00000100:00100000:3.0:1788851116.370339:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.370466:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814464 00000100:00100000:2.0:1788851116.370478:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814464 00000100:00100000:2.0:1788851116.370561:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 173 00000100:00100000:2.0:1788851116.370571:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+51:12360:x1875746000814464:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851116.370593:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851116.370616:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851116.370730:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788851116.370831:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c96 expref: 53 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.370843:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8dc9b500) 00010000:00010000:2.0:1788851116.370846:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851116.370851:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2064e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c96 expref: 53 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.370884:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94000, rc 0) 00000100:00100000:2.0:1788851116.370942:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+52:12360:x1875746000814464:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 372us (614us total) trans 4294967448 rc 301/301 00000100:00100000:2.0:1788851116.370949:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 173 00000100:00100000:1.0:1788851116.378911:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.379048:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814720 00000100:00100000:3.0:1788851116.379058:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814720 00000100:00100000:3.0:1788851116.379167:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:3.0:1788851116.379179:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbb2f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+52:12360:x1875746000814720:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851116.379473:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbb2f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+53:12360:x1875746000814720:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 295us (569us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788851116.379480:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:0.0:1788851116.438987:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851116.439111:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814976 00000100:00100000:1.0:1788851116.439122:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814976 00000100:00100000:1.0:1788851116.439191:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 174 00000100:00100000:1.0:1788851116.439201:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+53:12366:x1875746000814976:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1788851116.439229:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851116.439252:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2064f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38c9d expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.439361:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.439390:0:10526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c8f expref: 54 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.439400:0:10526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.439438:0:10526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c8f expref: 54 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.439465:0:10526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c8f expref: 54 pid: 6536 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851116.439480:0:10526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bab480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019753216:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851116.439593:0:10526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea54436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851116.445301:0:10526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bab480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019753216:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851116.445340:0:10526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851116.446516:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851116.447205:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000815104 00000100:00100000:1.0:1788851116.447216:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000815104 00010000:00010000:1.0:1788851116.447276:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c8f expref: 55 pid: 6536 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851116.447328:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:1.0:1788851116.447340:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+55:2407:x1875746000815104:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851116.447358:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851116.447385:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c8f expref: 55 pid: 6536 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.447399:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c8f expref: 55 pid: 6536 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.447428:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2064dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c8f expref: 55 pid: 6536 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.447449:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851116.447465:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.447477:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.447485:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.447529:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851116.447604:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+54:2407:x1875746000815104:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 267us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851116.447612:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 85 00010000:00010000:3.0:1788851116.447791:0:10526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.447800:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851116.447821:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788851116.447968:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2064f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c9d expref: 55 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.447988:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c9d expref: 54 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.447997:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851116.448000:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851116.448003:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030c00, rc 0) 00000100:00100000:3.0:1788851116.448078:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+54:12366:x1875746000814976:12345-192.168.204.27@tcp:101:bash.0 Request processed in 8879us (9100us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788851116.448093:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 174 00000100:00100000:0.0:1788851116.451660:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.451817:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000815360 00000100:00100000:3.0:1788851116.451827:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000815360 00000100:00100000:3.0:1788851116.451895:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00100000:3.0:1788851116.451910:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e90055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+54:12366:x1875746000815360:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:3.0:1788851116.452182:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.452203:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.452215:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851116.452261:0:9543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1788851116.452283:0:9543:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cdc71b5 reply state 00000000fcdf8b80 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.452294:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.452301:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851116.452303:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851116.452307:0:9543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851116.452393:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e90055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+57:12366:x1875746000815360:12345-192.168.204.27@tcp:36:bash.0 Request processed in 488us (757us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788851116.452399:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 175 00000020:00080000:3.0:1788851116.452403:0:9543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788851116.457803:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.457894:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000815488 00000100:00100000:3.0:1788851116.457918:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000815488 00000100:00100000:3.0:1788851116.457987:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 176 00000100:00100000:3.0:1788851116.457997:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+57:12366:x1875746000815488:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851116.458049:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851116.458070:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b20650d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ca4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.458163:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.458179:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c9d expref: 58 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.458188:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.458222:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c9d expref: 58 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.458236:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c9d expref: 58 pid: 10526 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851116.458249:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019753344:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851116.458332:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87a41540 going to sleep for 11 seconds 00000100:00100000:0.0:1788851116.461508:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.461688:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000815616 00000100:00100000:2.0:1788851116.461701:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000815616 00010000:00010000:2.0:1788851116.461743:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c9d expref: 59 pid: 10526 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851116.461785:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:2.0:1788851116.461796:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+59:2408:x1875746000815616:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851116.461814:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851116.461821:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c9d expref: 59 pid: 10526 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.461834:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c9d expref: 59 pid: 10526 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.461858:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851116.461864:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.461875:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.461884:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.461926:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851116.461991:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+59:2408:x1875746000815616:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 197us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851116.461998:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 86 00010000:00010000:3.0:1788851116.462710:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2064f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c9d expref: 58 pid: 10526 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851116.462731:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019753344:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851116.462767:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.462777:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.462782:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851116.462835:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788851116.462839:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851116.462858:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.462889:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b20650d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ca4 expref: 58 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.462905:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ca4 expref: 57 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.462912:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851116.462915:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851116.462918:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8200, rc 0) 00000100:00100000:3.0:1788851116.462966:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+57:12366:x1875746000815488:12345-192.168.204.27@tcp:101:bash.0 Request processed in 4971us (5175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851116.462973:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 176 00000100:00100000:0.0:1788851116.466319:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.466417:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000815872 00000100:00100000:2.0:1788851116.466428:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000815872 00000100:00100000:3.0:1788851116.466618:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:3.0:1788851116.466632:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+57:12366:x1875746000815872:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1788851116.466927:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+58:12366:x1875746000815872:12345-192.168.204.27@tcp:35:bash.0 Request processed in 297us (613us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788851116.466951:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:1.0:1788851116.547897:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.548043:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816128 00000100:00100000:3.0:1788851116.548057:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816128 00000100:00100000:3.0:1788851116.548132:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 177 00000100:00100000:3.0:1788851116.548144:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+58:12376:x1875746000816128:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851116.548171:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851116.548195:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b20651b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cab expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851116.548299:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788851116.548400:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b20651b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cab expref: 60 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.548414:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8dc9b500) 00010000:00010000:3.0:1788851116.548417:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851116.548422:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b20651b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cab expref: 60 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.548439:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9e00, rc 0) 00000100:00100000:3.0:1788851116.548528:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+59:12376:x1875746000816128:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 377us (634us total) trans 4294967454 rc 301/301 00000100:00100000:3.0:1788851116.548535:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 177 00000100:00100000:0.0:1788851116.552235:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.552338:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816256 00000100:00100000:2.0:1788851116.552350:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816256 00000100:00100000:2.0:1788851116.552415:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:2.0:1788851116.552425:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+59:12376:x1875746000816256:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:2.0:1788851116.552511:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552539:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552560:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552572:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552579:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552585:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552672:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552694:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552702:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851116.552750:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552761:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552767:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552774:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552780:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.552783:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552790:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552801:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851116.552804:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.552809:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552816:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b206529 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552835:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552842:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552848:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552852:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.552855:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552861:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552868:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8d8f4c00) 00010000:00010000:2.0:1788851116.552870:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.552873:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552878:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206530 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552887:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552893:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552899:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552910:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.552913:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552919:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552926:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851116.552928:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.552931:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.552937:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206537 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851116.553052:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+59:12376:x1875746000816256:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 628us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851116.553060:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 178 00000100:00100000:0.0:1788851116.556397:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.556497:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816512 00000100:00100000:3.0:1788851116.556508:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816512 00000100:00100000:3.0:1788851116.556595:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:3.0:1788851116.556606:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+59:12376:x1875746000816512:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851116.556870:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+60:12376:x1875746000816512:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 265us (481us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788851116.556877:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1788851116.592409:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.592506:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816768 00000100:00100000:3.0:1788851116.592525:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816768 00000100:00100000:3.0:1788851116.592663:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:3.0:1788851116.592676:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+60:12379:x1875746000816768:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851116.592704:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851116.592731:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b20653e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cb2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.592828:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.592844:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.592858:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.592871:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.592879:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.592886:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.593760:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206553 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.593777:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.593786:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206553 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851116.593798:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788851116.593899:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.593928:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.593935:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.593941:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.593945:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.593952:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.593965:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851116.593968:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.593973:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.593980:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206545 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594081:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594089:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594095:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594100:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.594110:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594117:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594126:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8d8f4c00) 00010000:00010000:2.0:1788851116.594129:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.594133:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594138:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b20654c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594182:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b20653e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cb2 expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594196:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206553 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cb2 expref: 62 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.594204:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851116.594206:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851116.594208:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95000, rc 0) 00000100:00100000:2.0:1788851116.594336:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+62:12379:x1875746000816768:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1662us (1936us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788851116.594344:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 179 00000100:00100000:0.0:1788851116.599313:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851116.599354:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.599604:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816896 00000100:00100000:3.0:1788851116.599633:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816896 00000100:00100000:3.0:1788851116.599703:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:3.0:1788851116.599714:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+62:12379:x1875746000816896:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1788851116.599779:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.599797:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.599808:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.599845:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.599853:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.599860:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.599866:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851116.599870:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.599876:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.599888:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851116.599891:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851116.599895:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.599911:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206561 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851116.599984:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+62:12379:x1875746000816896:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 271us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851116.599991:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 180 00000100:00100000:1.0:1788851116.602338:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817024 00000100:00100000:1.0:1788851116.602354:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817024 00000100:00100000:1.0:1788851116.602421:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:1.0:1788851116.602432:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+62:2408:x1875746000817024:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851116.602448:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851116.602502:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b206553 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cb2 expref: 62 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851116.602533:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851116.602537:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851116.602877:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+61:2408:x1875746000817024:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 446us (3520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851116.602885:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1788851116.603000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.604076:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817280 00000100:00100000:3.0:1788851116.604088:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817280 00000100:00100000:3.0:1788851116.604147:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:3.0:1788851116.604156:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+61:12379:x1875746000817280:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851116.604379:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+62:12379:x1875746000817280:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 224us (1380us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788851116.604385:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:2.0:1788851116.762882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.763111:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817536 00000100:00100000:3.0:1788851116.763123:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817536 00000100:00100000:3.0:1788851116.763204:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:3.0:1788851116.763216:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+62:12397:x1875746000817536:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:3.0:1788851116.763241:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851116.763262:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206568 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cb9 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.763365:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b20656f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.763383:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b20656f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.763415:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b20656f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851116.763428:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788851116.763573:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206568 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cb9 expref: 65 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.763597:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b20656f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cb9 expref: 64 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.763605:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851116.763609:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788851116.763613:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8400, rc 0) 00000100:00100000:3.0:1788851116.763677:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+64:12397:x1875746000817536:12345-192.168.204.27@tcp:101:cat.0 Request processed in 464us (806us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788851116.763684:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 181 00000100:00100000:1.0:1788851116.801364:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.801691:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817664 00000100:00100000:2.0:1788851116.801702:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817664 00000100:00100000:2.0:1788851116.801770:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:2.0:1788851116.801800:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+64:12398:x1875746000817664:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851116.801826:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851116.801848:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20657d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cc0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.801918:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206584 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.801937:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.801952:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851116.802053:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788851116.802058:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851116.802079:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.802110:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b20657d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc0 expref: 66 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.802134:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc0 expref: 65 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.802143:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851116.802146:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851116.802150:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94c00, rc 0) 00000100:00100000:2.0:1788851116.802228:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+65:12398:x1875746000817664:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 431us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851116.802246:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 182 00000100:00100000:2.0:1788851116.814381:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.814579:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818048 00000100:00100000:3.0:1788851116.814592:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818048 00000100:00100000:3.0:1788851116.814666:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:3.0:1788851116.814677:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+65:12398:x1875746000818048:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851116.815413:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+66:12398:x1875746000818048:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 736us (1041us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788851116.815422:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000001:00080000:2.0:1788851116.826913:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788851116.826965:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1788851116.827209:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827224:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827250:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827257:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851116.827262:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827271:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827287:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff892e8d8f4300) 00010000:00010000:3.0:1788851116.827290:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851116.827295:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827301:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206354 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827322:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827328:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827335:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827340:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851116.827343:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827357:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827366:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:3.0:1788851116.827368:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851116.827371:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827377:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20635b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827392:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827399:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827405:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827411:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2154800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851116.827414:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827420:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827427:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8d8f4c00) 00010000:00010000:3.0:1788851116.827429:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851116.827432:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827456:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2154800/0x3e0030720b20639a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827475:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827490:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827496:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827501:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851116.827505:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827522:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827531:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851116.827533:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851116.827543:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827550:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20649d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827561:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827567:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827579:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827584:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851116.827587:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827593:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827600:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851116.827603:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851116.827605:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827611:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2064c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827622:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827629:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827635:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827640:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851116.827643:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827658:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827667:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851116.827669:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851116.827672:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.827679:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b206506 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851116.830989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.831121:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818176 00000100:00100000:3.0:1788851116.831133:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818176 00000100:00100000:3.0:1788851116.831221:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:3.0:1788851116.831232:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+35:12398:x1875746000818176:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:3.0:1788851116.831249:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788851116.831280:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206514 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ca4 expref: 35 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.831312:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b20656f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cb9 expref: 34 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.831326:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b206411 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c5e expref: 33 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.831337:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851116.831343:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851116.831397:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+32:12398:x1875746000818176:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 166us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851116.831419:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1788851116.836378:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019753472:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788851116.836463:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851116.836965:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019753472 00000100:00100000:0.0:1788851116.836974:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019753472 00000100:00100000:0.0:1788851116.837048:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788851116.837059:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019753472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788851116.837097:0:8449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1788851116.837134:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fb3aa, atime: 0x6a9fb3aa, ctime: 0x6a9fb3aa, blocks: 0x8 00010000:00010000:0.0:1788851116.837171:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.837189:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1788851116.837194:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851116.837203:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.837221:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.837232:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.837241:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.837262:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788851116.837411:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875746019753472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 353us (948us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788851116.837420:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1788851116.837426:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851116.837435:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.837445:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851116.837449:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.837460:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.837480:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.837487:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046f8b3b2/0x3e0030720b20658b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.837508:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851116.837509:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851116.837521:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788851116.837747:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892d87b8ed80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1788851116.837755:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019753472:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788851116.837838:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff892eb6ccd480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788851116.837843:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892e83306100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff892ead218e40 00000020:00080000:2.0:1788851116.837846:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892d81aa2900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff892e898f7c00 00000020:00080000:3.0:1788851116.837952:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788851116.837993:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788851116.847214:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.847319:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818304 00000100:00100000:3.0:1788851116.847331:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818304 00000100:00100000:3.0:1788851116.847402:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:3.0:1788851116.847411:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+16:12398:x1875746000818304:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:3.0:1788851116.847703:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.847721:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.847733:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851116.847841:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788851116.847935:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+16:12398:x1875746000818304:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 524us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851116.847943:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 183 00000100:00100000:3.0:1788851116.876864:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851116.877000:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818432 00000100:00100000:0.0:1788851116.877056:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818432 00000100:00100000:0.0:1788851116.877122:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 184 00000100:00100000:0.0:1788851116.877133:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+16:12400:x1875746000818432:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851116.877156:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851116.877177:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206599 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cc7 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877263:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877281:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877294:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877308:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877315:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877322:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877402:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877412:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877420:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851116.877475:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788851116.877479:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851116.877496:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877530:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877539:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877545:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877552:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877559:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bca00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851116.877563:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877571:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877583:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:0.0:1788851116.877586:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851116.877591:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877598:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b2065a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877613:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877619:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877631:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877636:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851116.877639:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877645:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877653:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892d87409300) 00010000:00010000:0.0:1788851116.877655:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851116.877658:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877664:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2065a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877697:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206599 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc7 expref: 18 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877711:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc7 expref: 17 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851116.877719:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:0.0:1788851116.877721:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851116.877723:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bde00, rc 0) 00000100:00100000:0.0:1788851116.877784:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+17:12400:x1875746000818432:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 653us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851116.877800:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 184 00000040:00080000:1.0:1788851116.916323:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851116.916333:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851116.916357:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:1.0:1788851116.916365:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788851116.916525:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019753600:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851116.916694:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443480 going to sleep for 11 seconds 00000100:00100000:1.0:1788851116.926639:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019753600:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851116.949630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.949898:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818560 00000100:00100000:3.0:1788851116.949909:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818560 00000100:00100000:3.0:1788851116.949978:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:3.0:1788851116.949992:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+17:12407:x1875746000818560:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851116.950060:0:10526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851116.950220:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+17:12407:x1875746000818560:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 231us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851116.950227:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 185 00000100:00100000:3.0:1788851116.954833:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.954958:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818688 00000100:00100000:2.0:1788851116.954970:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818688 00000100:00100000:2.0:1788851116.955057:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:2.0:1788851116.955068:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+17:12407:x1875746000818688:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788851116.955148:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955165:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955179:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955194:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955201:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955206:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955257:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955267:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955274:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851116.955322:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788851116.955327:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851116.955341:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955351:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955358:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955365:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955371:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.955376:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955384:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955396:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:2.0:1788851116.955406:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.955412:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955418:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b2065b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955432:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955438:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955460:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955465:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.955468:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955475:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955482:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff892e8a8cbf00) 00010000:00010000:2.0:1788851116.955485:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.955488:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955494:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2065bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955519:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955531:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955537:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955543:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.955546:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955552:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955559:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851116.955561:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851116.955564:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.955570:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b2065c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851116.955651:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+17:12407:x1875746000818688:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 583us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851116.955659:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 186 00000100:00100000:0.0:1788851116.958137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.958835:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818944 00000100:00100000:2.0:1788851116.958847:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818944 00000100:00100000:2.0:1788851116.958913:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:2.0:1788851116.958924:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+17:12407:x1875746000818944:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851116.958950:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851116.958995:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2065ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959158:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959177:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959191:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851116.959204:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788851116.959304:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959312:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959319:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959325:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851116.959329:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959338:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959351:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851116.959354:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851116.959360:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959378:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2065d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959427:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2065ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cce expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959437:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:2.0:1788851116.959454:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851116.959459:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b2065ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cce expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.959469:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7000, rc 0) 00000100:00100000:2.0:1788851116.959560:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+18:12407:x1875746000818944:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 638us (1436us total) trans 4294967460 rc 301/301 00000100:00100000:2.0:1788851116.959569:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 187 00000100:00100000:1.0:1788851116.963464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.963569:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819072 00000100:00100000:3.0:1788851116.963579:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819072 00000100:00100000:3.0:1788851116.963640:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:3.0:1788851116.963652:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+18:12407:x1875746000819072:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851116.963697:0:6536:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851116.963852:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+18:12407:x1875746000819072:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 200us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851116.963860:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 188 00000100:00100000:0.0:1788851116.971935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.972052:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819328 00000100:00100000:2.0:1788851116.972063:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819328 00000100:00100000:2.0:1788851116.972136:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:2.0:1788851116.972147:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+18:12407:x1875746000819328:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851116.972168:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851116.972172:0:9543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788851116.972198:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b206584 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc0 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.972216:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851116.972221:0:9543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851116.972252:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b2065df lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cd5 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851116.972731:0:9543:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788851116.972879:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2065e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.972894:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2065e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.972906:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2065e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.972957:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b2065df lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cd5 expref: 20 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.972974:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2065e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cd5 expref: 19 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.972982:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cbf00) 00010000:00010000:2.0:1788851116.972984:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851116.972987:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6600, rc 0) 00000100:00100000:2.0:1788851116.973096:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+19:12407:x1875746000819328:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 950us (1173us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788851116.973104:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 189 00000100:00100000:0.0:1788851116.976397:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.976574:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819584 00000100:00100000:3.0:1788851116.976583:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819584 00000100:00100000:3.0:1788851116.976658:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:3.0:1788851116.976669:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+19:12407:x1875746000819584:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851116.976735:0:10526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851116.976763:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2065e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cd5 expref: 19 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976784:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cbf00) 00010000:00010000:3.0:1788851116.976797:0:10526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851116.976822:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976836:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976846:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976898:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976905:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976913:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976975:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976983:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976991:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.976998:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851116.977002:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977009:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977069:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:3.0:1788851116.977072:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851116.977077:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977084:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b2065f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977097:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977103:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977109:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977120:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851116.977124:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977130:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977138:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x3e96d266 (ffff892ea5408b00) 00010000:00010000:3.0:1788851116.977140:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851116.977143:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.977149:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b2065fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3e96d266 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851116.977228:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+18:12407:x1875746000819584:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 560us (842us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788851116.977236:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 190 00000100:00100000:0.0:1788851116.979678:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851116.979780:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819712 00000100:00100000:2.0:1788851116.979791:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819712 00000100:00100000:2.0:1788851116.979851:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:2.0:1788851116.979861:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+18:12407:x1875746000819712:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851116.979898:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851116.979919:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206602 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.979950:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.979963:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.979976:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.980116:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206602 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cdc expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.980136:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cdc expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851116.980144:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:2.0:1788851116.980147:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788851116.980151:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7000, rc 0) 00000100:00100000:2.0:1788851116.980209:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:12407:x1875746000819712:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 349us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851116.980216:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 191 00000100:00100000:0.0:1788851116.989454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851116.989669:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819968 00000100:00100000:3.0:1788851116.989682:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819968 00000100:00100000:3.0:1788851116.989758:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:3.0:1788851116.989769:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+19:12407:x1875746000819968:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851116.989854:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.989872:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.989883:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851116.990442:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788851116.990453:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 451049439896ns, next at 452049437022ns, rc = 0 00000004:00010000:3.0:1788851116.990529:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cb76080 reply state 000000008c945b06 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.990544:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851116.990551:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851116.990553:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788851116.990557:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851116.990658:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a5e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+21:12407:x1875746000819968:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 889us (1214us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788851116.990666:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 192 00000100:00100000:1.0:1788851117.010388:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851117.010489:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820096 00000100:00100000:3.0:1788851117.010500:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820096 00000100:00100000:3.0:1788851117.010581:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:3.0:1788851117.010592:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+21:12407:x1875746000820096:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851117.010615:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851117.010637:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ce3 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.010693:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ce3 expref: 22 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.010707:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ce3 expref: 22 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.010746:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851117.010749:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851117.010753:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8400, rc 0) 00000100:00100000:3.0:1788851117.011805:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+22:12407:x1875746000820096:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1209us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.011816:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 193 00000100:00100000:0.0:1788851117.027245:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851117.027377:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820224 00000100:00100000:1.0:1788851117.027398:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820224 00000100:00100000:1.0:1788851117.027472:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1788851117.027491:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+6:2407:x1875746000820224:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788851117.027766:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000820224:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 277us (532us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788851117.027774:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00080000:0.0:1788851117.029991:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851117.030039:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851117.030675:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820480 00000100:00100000:0.0:1788851117.030686:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820480 00000100:00100000:0.0:1788851117.030743:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:0.0:1788851117.030753:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+22:12407:x1875746000820480:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788851117.030982:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+23:12407:x1875746000820480:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 229us (945us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1788851117.030990:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:3.0:1788851117.033170:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851117.034245:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820736 00000100:00100000:0.0:1788851117.034259:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820736 00000100:00100000:0.0:1788851117.034327:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:0.0:1788851117.034337:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+23:12407:x1875746000820736:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788851117.034466:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+23:12407:x1875746000820736:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 130us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851117.034474:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 194 00000100:00100000:0.0:1788851117.041179:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851117.041259:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820864 00000100:00100000:1.0:1788851117.041269:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820864 00000100:00100000:1.0:1788851117.041332:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:1.0:1788851117.041343:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+23:12407:x1875746000820864:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851117.041363:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851117.041385:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20661e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cea expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.041453:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206625 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.041468:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.041491:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851117.041545:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851117.041564:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.041591:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20661e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cea expref: 25 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.041633:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206625 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cea expref: 24 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.041641:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:1.0:1788851117.041645:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788851117.041649:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031400, rc 0) 00000100:00100000:1.0:1788851117.041710:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+24:12407:x1875746000820864:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 369us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851117.041717:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 195 00000100:00100000:3.0:1788851117.047356:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851117.047537:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820992 00000100:00100000:0.0:1788851117.047547:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820992 00000100:00100000:0.0:1788851117.047628:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1788851117.047638:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000820992:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851117.047657:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851117.047676:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cf1 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851117.047699:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb3ac, blocks: 0x0 00010000:00010000:0.0:1788851117.047719:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788851117.047724:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851117.047732:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf1 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.047750:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf1 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.047762:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc200, rc 0) 00000100:00100000:0.0:1788851117.047815:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+8:2409:x1875746000820992:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 179us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851117.047822:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1788851117.051432:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851117.058630:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821248 00000100:00100000:3.0:1788851117.058648:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821248 00000100:00100000:3.0:1788851117.058763:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:3.0:1788851117.058775:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+24:12407:x1875746000821248:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788851117.058903:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+24:12407:x1875746000821248:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 131us (7480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.058913:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 196 00000100:00100000:0.0:1788851117.069309:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851117.069372:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821376 00000100:00100000:1.0:1788851117.069382:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821376 00000100:00100000:1.0:1788851117.069443:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1788851117.069454:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:12407:x1875746000821376:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851117.069473:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851117.069492:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cf8 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.069535:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf1 expref: 9 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.069544:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851117.069549:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851117.069554:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.069613:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf1 expref: 9 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.069629:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf1 expref: 9 pid: 8449 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851117.069647:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8447:1875746019753728:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851117.069739:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443480 going to sleep for 11 seconds 00000100:00100000:1.0:1788851117.071876:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851117.071947:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821504 00000100:00100000:0.0:1788851117.071955:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821504 00010000:00010000:0.0:1788851117.071992:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf1 expref: 10 pid: 8449 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851117.072042:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:0.0:1788851117.072061:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+10:2408:x1875746000821504:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851117.072075:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851117.072095:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf1 expref: 10 pid: 8449 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.072109:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf1 expref: 10 pid: 8449 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.072133:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851117.072137:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851117.072144:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.072154:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.072186:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851117.072199:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6519:1875746019753856:192.168.204.27@tcp:105: 00000100:00100000:0.0:1788851117.072262:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead7399c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788851117.072736:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b20662c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf1 expref: 10 pid: 8449 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851117.072752:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8447:1875746019753728:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851117.072778:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.072790:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030c00, rc 0) 00000100:00100000:3.0:1788851117.072835:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+9:12407:x1875746000821376:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 3383us (3535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.072850:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:0.0:1788851117.076346:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6519:1875746019753856:192.168.204.27@tcp:105: 00010000:00010000:0.0:1788851117.076374:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851117.076447:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000821504:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 4379us (4569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851117.076472:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:1.0:1788851117.088069:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851117.088175:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821632 00000100:00100000:3.0:1788851117.088186:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821632 00002000:00100000:3.0:1788851117.088239:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff892ea7d64e00 x1875746000821632/t0(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:183/0 lens 504/0 e 0 to 0 dl 1788851128 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851117.088251:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea7d64e00 with x1875746000821632 ext(0->8) 00002000:00010000:3.0:1788851117.088257:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892ea7d64e00 00000100:00100000:3.0:1788851117.088370:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:3.0:1788851117.088381:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000821632:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788851117.092392:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+10:2407:x1875746000821632:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 4001us (4322us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788851117.092408:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00002000:00100000:3.0:1788851117.092423:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff892ea7d64e00 x1875746000821632/t4294967315(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:183/0 lens 504/448 e 0 to 0 dl 1788851128 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851117.092435:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea7d64e00 with x1875746000821632 ext(0->8) 00002000:00010000:3.0:1788851117.092448:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892ea7d64e00 00000100:00100000:0.0:1788851117.103557:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851117.103749:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821760 00000100:00100000:2.0:1788851117.103759:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821760 00000100:00100000:2.0:1788851117.103820:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 197 00000100:00100000:2.0:1788851117.103831:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+24:12407:x1875746000821760:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788851117.107766:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:2.0:1788851117.107785:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788851117.107810:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788851117.107837:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788851117.107848:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788851117.107995:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+20:12407:x1875746000821760:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 4158us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851117.108008:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 197 00010000:00010000:0.0:1788851117.108488:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.108503:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.108524:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.108531:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851117.108537:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.108556:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.108574:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:0.0:1788851117.108577:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788851117.108583:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.108590:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206610 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851117.108787:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019753984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788851117.108849:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851117.108947:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019753984 00000100:00100000:0.0:1788851117.108957:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019753984 00000100:00100000:0.0:1788851117.109062:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788851117.109072:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019753984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788851117.109227:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788851117.109231:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788851116 00002000:00010000:0.0:1788851117.109234:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788851117.109236:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788851116 -> 1788851116 00002000:00010000:0.0:1788851117.109238:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788851117.109279:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019753984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (430us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788851117.109287:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1788851117.109330:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892ea7d67800/2, rc 0, transno 4294967316 00000100:00100000:0.0:1788851117.109338:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019753984:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788851117.109397:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851117.113348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851117.113484:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821888 00000100:00100000:0.0:1788851117.113495:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821888 00000100:00100000:0.0:1788851117.113568:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:0.0:1788851117.113578:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+10:2409:x1875746000821888:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788851117.119762:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1788851117.119775:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1788851117.120817:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000821888:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 7233us (7471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851117.120829:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:1.0:1788851117.131715:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851117.131856:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822144 00000100:00100000:3.0:1788851117.131868:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822144 00000100:00100000:3.0:1788851117.131932:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:3.0:1788851117.131943:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:12407:x1875746000822144:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851117.131998:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851117.132056:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206625 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cea expref: 19 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.132096:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851117.132101:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851117.132131:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.132145:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.132155:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851117.132282:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa446bd2 reply state 00000000bdb92b5a transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.132295:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.132302:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851117.132305:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851117.132308:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851117.132396:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+20:12407:x1875746000822144:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 454us (689us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1788851117.132403:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 198 00000100:00100000:2.0:1788851117.145163:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851117.145240:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822272 00000100:00100000:3.0:1788851117.145250:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822272 00000100:00100000:3.0:1788851117.145312:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:3.0:1788851117.145323:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000822272:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788851117.145488:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788851117.145501:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788851116 -> 1788851116 00002000:00010000:3.0:1788851117.145503:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788851114 00002000:00010000:3.0:1788851117.145515:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788851116 -> 1788851116 00002000:00010000:3.0:1788851117.145518:0:8449:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788851117.145590:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000822272:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 268us (436us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788851117.145610:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:2.0:1788851117.148470:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851117.148607:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822528 00000100:00100000:3.0:1788851117.148618:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822528 00000100:00100000:3.0:1788851117.148673:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:3.0:1788851117.148682:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+20:12407:x1875746000822528:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788851117.148751:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.148769:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cdc expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.148778:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.148812:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cdc expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.148825:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cdc expref: 20 pid: 6535 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851117.148840:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6536:1875746019754112:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851117.148925:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851117.152072:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6536:1875746019754112:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851117.152105:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851117.159067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851117.159399:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822656 00000100:00100000:3.0:1788851117.159409:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822656 00010000:00010000:3.0:1788851117.159463:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cdc expref: 21 pid: 6535 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851117.159499:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:3.0:1788851117.159520:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+21:2408:x1875746000822656:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851117.159544:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851117.159552:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cdc expref: 21 pid: 6535 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.159567:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cdc expref: 21 pid: 6535 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.159588:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206609 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cdc expref: 21 pid: 6535 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.159612:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851117.159617:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.159630:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.159639:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.159675:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851117.159725:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+20:2408:x1875746000822656:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 217us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.159742:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 88 00010000:00010000:2.0:1788851117.159996:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.160005:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.160068:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.160075:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.160082:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.160098:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851117.160103:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.160111:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.160121:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:2.0:1788851117.160123:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788851117.160128:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.160135:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8200/0x3e0030720b206641 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851117.160179:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+19:12407:x1875746000822528:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 11497us (11720us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788851117.160187:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 199 00000100:00100000:3.0:1788851117.166918:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851117.167108:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822784 00000100:00100000:2.0:1788851117.167120:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822784 00000100:00100000:2.0:1788851117.167185:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:2.0:1788851117.167196:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000822784:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788851117.167249:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.167270:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.167296:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851117.167300:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851117.167305:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.167340:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.167353:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 8 pid: 8447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851117.167368:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8447:1875746019754240:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851117.167463:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788851117.171159:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8447:1875746019754240:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851117.171190:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851117.172198:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851117.172280:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822912 00000100:00100000:2.0:1788851117.172290:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822912 00010000:00010000:2.0:1788851117.172331:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 9 pid: 8447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851117.172377:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 89 00000100:00100000:2.0:1788851117.172386:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+9:2407:x1875746000822912:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851117.172403:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851117.172427:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 9 pid: 8447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172469:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 9 pid: 8447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172497:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b206633 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cf8 expref: 9 pid: 8447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172525:0:7476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851117.172530:0:7476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851117.172544:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172555:0:7476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172584:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851117.172646:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000822912:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 260us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851117.172654:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 89 00010000:00010000:2.0:1788851117.172742:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172751:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172771:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172786:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172793:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172799:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851117.172804:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172813:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172825:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.172833:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b206648 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851117.172882:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000822784:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 5688us (5975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851117.172890:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:3.0:1788851117.175382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851117.175457:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823168 00000100:00100000:2.0:1788851117.175465:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823168 00000100:00100000:2.0:1788851117.175526:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 200 00000100:00100000:2.0:1788851117.175562:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+19:12407:x1875746000823168:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788851117.175659:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.175675:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c81 expref: 19 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.175684:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.175717:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c81 expref: 19 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.175731:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c81 expref: 19 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851117.175745:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88269f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019754368:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851117.175823:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851117.178689:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88269f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019754368:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851117.178726:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851117.185893:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851117.185971:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823296 00000100:00100000:0.0:1788851117.185982:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823296 00010000:00010000:0.0:1788851117.186053:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c81 expref: 20 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851117.186093:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 90 00000100:00100000:0.0:1788851117.186104:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+20:2408:x1875746000823296:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851117.186128:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851117.186137:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c81 expref: 20 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.186151:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c81 expref: 20 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.186174:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b206496 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c81 expref: 20 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.186188:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:0.0:1788851117.186193:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.186204:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.186213:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.186248:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851117.186299:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.186309:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851117.186315:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+19:2408:x1875746000823296:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 213us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851117.186322:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 90 00010000:00010000:1.0:1788851117.186518:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.186541:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ce3 expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.186561:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.186592:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ce3 expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.186605:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ce3 expref: 19 pid: 6536 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851117.186619:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019754496:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851117.186674:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea54433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851117.195389:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019754496:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851117.195666:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851117.199158:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851117.200697:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823424 00000100:00100000:1.0:1788851117.200710:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823424 00010000:00010000:1.0:1788851117.200755:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ce3 expref: 20 pid: 6536 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851117.200801:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 91 00000100:00100000:1.0:1788851117.200811:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+20:2407:x1875746000823424:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851117.200831:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851117.200838:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ce3 expref: 20 pid: 6536 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.200851:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ce3 expref: 20 pid: 6536 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.200874:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8400/0x3e0030720b206617 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ce3 expref: 20 pid: 6536 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.200905:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:1.0:1788851117.200911:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.200921:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.200930:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.200964:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851117.201049:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+19:2407:x1875746000823424:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 239us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851117.201057:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 91 00010000:00010000:0.0:1788851117.201293:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.201303:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851117.201406:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1788851117.201538:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:0.0:1788851117.201579:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788851117.201661:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6534:1875746019754624:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788851117.201717:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851117.201744:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851117.201918:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019754624 00000100:00100000:3.0:1788851117.201924:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019754624 00000100:00100000:3.0:1788851117.208258:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788851117.208295:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6534:x1875746019754624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788851117.208495:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6534:x1875746019754624:12345-0@lo:1000:mdt00_000.0 Request processed in 217us (6777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.208514:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788851117.209248:0:6534:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788851117.209258:0:6534:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892ea7d67800, transno 4294967316 00000100:00100000:2.0:1788851117.209277:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6534:1875746019754624:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788851117.209467:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:2.0:1788851117.210201:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6534:1875746019754752:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788851117.210273:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851117.210312:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851117.210873:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019754752 00000100:00100000:1.0:1788851117.210881:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019754752 00000100:00100000:1.0:1788851117.210935:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788851117.210944:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6534:x1875746019754752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788851117.211136:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6534:x1875746019754752:12345-0@lo:1000:mdt00_000.0 Request processed in 193us (862us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788851117.211145:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788851117.211239:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6534:1875746019754752:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788851117.211291:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211302:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211311:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211318:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851117.211323:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211332:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211348:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:2.0:1788851117.211351:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851117.211356:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211363:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206656 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211387:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211394:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211400:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211417:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851117.211420:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211428:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211449:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:2.0:1788851117.211452:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851117.211456:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211462:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9800/0x3e0030720b206592 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211489:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211569:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc7 expref: 22 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211578:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211609:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc7 expref: 22 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851117.211624:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc7 expref: 22 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851117.211649:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019754880:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851117.211761:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851117.223960:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851117.224075:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019754880:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851117.224105:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851117.224279:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823552 00000100:00100000:3.0:1788851117.224288:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823552 00010000:00010000:3.0:1788851117.224325:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc7 expref: 23 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851117.224365:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 92 00000100:00100000:3.0:1788851117.224376:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+23:2408:x1875746000823552:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851117.224406:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851117.224413:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc7 expref: 23 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.224428:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc7 expref: 23 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.224584:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2065ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cc7 expref: 23 pid: 9543 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.224601:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851117.224606:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.224616:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.224624:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.224652:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851117.224711:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+22:2408:x1875746000823552:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 335us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.224718:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 92 00010000:00010000:1.0:1788851117.225228:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225246:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225261:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225268:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225274:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225280:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851117.225284:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225291:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225301:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851117.225304:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851117.225308:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225313:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20665d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225324:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225331:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225342:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225347:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851117.225349:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225355:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225362:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851117.225365:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788851117.225368:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.225374:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20664f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851117.225709:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+21:12407:x1875746000823168:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 50152us (50333us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788851117.225718:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 200 00000020:00080000:1.0:1788851117.225723:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788851117.226085:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851117.226090:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851117.226959:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788851117.226972:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788851117.237129:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851117.238370:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851117.238471:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823808 00000100:00100000:1.0:1788851117.238482:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823808 00000100:00100000:1.0:1788851117.238550:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1788851117.238561:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbb2fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+21:12407:x1875746000823808:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788851117.238827:0:6538:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788851117.238861:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:1.0:1788851117.238908:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.238924:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.238937:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.238947:0:6538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.238955:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.238962:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.238988:0:6538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788851117.239108:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbb2fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+23:12407:x1875746000823808:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 548us (743us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788851117.239116:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000020:00080000:1.0:1788851117.239122:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788851117.240008:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851117.240044:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.240054:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851117.240059:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.240069:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.240084:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:0.0:1788851117.240088:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788851117.240093:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.240100:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206664 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.240137:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851117.240139:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851117.240141:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851117.778737:0:14725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851117.778748:0:14725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851117.778775:0:14725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:1.0:1788851117.778780:0:14725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788851117.942544:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851117.942707:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824064 00000100:00100000:3.0:1788851117.942717:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824064 00000100:00100000:3.0:1788851117.942777:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 201 00000100:00100000:3.0:1788851117.942787:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+23:12421:x1875746000824064:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851117.942811:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851117.942834:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b20666b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38cff expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.942942:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b206672 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.942956:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b206672 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.942970:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b206672 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851117.942982:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788851117.943140:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b20666b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cff expref: 26 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.943159:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b206672 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cff expref: 25 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.943168:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:3.0:1788851117.943172:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851117.943175:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8000, rc 0) 00000100:00100000:3.0:1788851117.943245:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+25:12421:x1875746000824064:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 459us (708us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788851117.943261:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 201 00000100:00100000:1.0:1788851117.951204:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851117.951278:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824192 00000100:00100000:0.0:1788851117.951287:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824192 00000100:00100000:0.0:1788851117.951346:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 202 00000100:00100000:0.0:1788851117.951356:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+25:12421:x1875746000824192:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:0.0:1788851117.951432:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951450:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951463:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951478:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951485:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951505:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951582:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951591:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951610:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851117.951662:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951675:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951681:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951689:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951695:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851117.951700:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951708:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951719:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:0.0:1788851117.951722:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851117.951727:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951734:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b206680 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951747:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951759:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951766:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951771:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851117.951774:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951780:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951788:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892d87409000) 00010000:00010000:0.0:1788851117.951791:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851117.951794:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951800:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951814:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951820:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951826:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951831:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bce00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851117.951839:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951846:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951854:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409400) 00010000:00010000:0.0:1788851117.951856:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851117.951859:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.951866:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b20668e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851117.951945:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+25:12421:x1875746000824192:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 589us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851117.951953:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 202 00000100:00100000:0.0:1788851118.005584:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019755392:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.005659:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.005719:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019755904:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.005746:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.005766:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019756416:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.005783:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.005807:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788851118.005812:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019755008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851118.005833:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.005852:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019755520:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.005871:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.005894:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019756032:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.005916:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.005936:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019756544:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.005952:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.005973:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019755136:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.006001:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.006038:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019755648:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006267:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019755264:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006296:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851118.006316:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019755776:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006346:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851118.006369:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019756288:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006387:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851118.006414:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019755904 00000100:00100000:1.0:1788851118.006422:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019755904 00000100:00100000:1.0:1788851118.006464:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019756416 00000100:00100000:1.0:1788851118.006467:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019756416 00000100:00100000:1.0:1788851118.006481:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019755520 00000100:00100000:1.0:1788851118.006483:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019755520 00000100:00100000:1.0:1788851118.006510:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019755264 00000100:00100000:1.0:1788851118.006513:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019755264 00000100:00100000:1.0:1788851118.006524:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019755776 00000100:00100000:1.0:1788851118.006526:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019755776 00000100:00100000:1.0:1788851118.006537:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019756288 00000100:00100000:1.0:1788851118.006539:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019756288 00000100:00100000:1.0:1788851118.006555:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788851118.006564:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019755904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006617:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019755904:12345-0@lo:400:kworker.0 Request processed in 54us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.006624:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788851118.006641:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788851118.006647:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019756416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006671:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019756416:12345-0@lo:400:kworker.0 Request processed in 25us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.006677:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788851118.006687:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788851118.006693:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019755520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006717:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019755520:12345-0@lo:400:kworker.0 Request processed in 24us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.006728:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788851118.006740:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788851118.006745:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019755264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006775:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019755264:12345-0@lo:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.006780:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788851118.006792:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788851118.006798:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019755776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006821:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019755776:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.006827:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788851118.006837:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788851118.006843:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019756288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.006864:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019756288:12345-0@lo:400:kworker.0 Request processed in 22us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.006870:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:1.0:1788851118.006909:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851118.006913:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851118.006939:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019755520:0@lo:400:kworker.0 00010000:00080000:1.0:1788851118.006951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88287b80 x1875746019755904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851118.006961:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019755904:0@lo:400:kworker.0 00010000:00080000:1.0:1788851118.006970:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a39c00 x1875746019756416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851118.006991:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019756416:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.007048:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019756800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851118.007074:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851118.007097:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019755264:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.007105:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019755776:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.007113:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019756288:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.007137:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019755008 00000100:00100000:1.0:1788851118.007140:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019755008 00000100:00100000:1.0:1788851118.007167:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019756800 00000100:00100000:1.0:1788851118.007169:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019756800 00000100:00100000:1.0:1788851118.007183:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788851118.007188:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019755008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851118.007208:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851118.007241:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019755008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.007248:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788851118.007260:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788851118.007266:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019756800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851118.007276:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788851118.007304:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019756800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.007310:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1788851118.007326:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851118.007334:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851118.007356:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019755008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851118.007378:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019756800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851118.008104:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851118.008116:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019756928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851118.008159:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851118.008189:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019756032 00000100:00100000:2.0:1788851118.008194:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019756032 00000100:00100000:2.0:1788851118.008226:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019756544 00000100:00100000:2.0:1788851118.008229:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019756544 00000100:00100000:2.0:1788851118.008247:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788851118.008255:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019756032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851118.008290:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019756032:12345-0@lo:400:kworker.0 Request processed in 36us (2373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851118.008296:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788851118.008311:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788851118.008316:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019756544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851118.008343:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019756544:12345-0@lo:400:kworker.0 Request processed in 28us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851118.008348:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788851118.008404:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8834bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019757056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851118.008429:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851118.009686:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019756928 00000100:00100000:1.0:1788851118.009695:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019756928 00000100:00100000:1.0:1788851118.009741:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019757056 00000100:00100000:1.0:1788851118.009745:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019757056 00000100:00100000:1.0:1788851118.009759:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788851118.009766:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019756928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851118.009785:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851118.009846:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019756928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.009853:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788851118.009869:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788851118.009875:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8834b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019757056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851118.009886:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788851118.009911:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8834b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019757056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.009917:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788851118.009933:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851118.009972:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8834bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019757056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851118.009986:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019756928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851118.011674:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.011736:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019755392 00000100:00100000:0.0:1788851118.011744:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019755392 00000100:00100000:0.0:1788851118.011789:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019755648 00000100:00100000:0.0:1788851118.011793:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019755648 00000100:00100000:0.0:1788851118.011810:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788851118.011817:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019755392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.011871:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019755392:12345-0@lo:400:kworker.0 Request processed in 54us (6211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851118.011878:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788851118.011894:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788851118.011900:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e92eb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019755648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.011926:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e92eb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019755648:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851118.011932:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788851118.012105:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019756032:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.012139:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019756544:0@lo:400:kworker.0 00000100:00100000:1.0:1788851118.012151:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019755392:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.012812:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019755136 00000100:00100000:0.0:1788851118.012818:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019755136 00000100:00100000:0.0:1788851118.013701:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788851118.013713:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019755136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.013787:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019755136:12345-0@lo:400:kworker.0 Request processed in 78us (7784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851118.013794:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788851118.014170:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019755648:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.014182:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019756160:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.014232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.014261:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019756672:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.014282:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851118.014317:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019755136:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.014337:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019756160 00000100:00100000:0.0:1788851118.014342:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019756160 00000100:00100000:0.0:1788851118.014369:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019756672 00000100:00100000:0.0:1788851118.014372:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019756672 00000100:00100000:0.0:1788851118.014388:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788851118.014394:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019756160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.014427:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019756160:12345-0@lo:400:kworker.0 Request processed in 33us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851118.014433:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788851118.014444:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788851118.014450:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875746019756672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.014593:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875746019756672:12345-0@lo:400:kworker.0 Request processed in 143us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851118.014600:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788851118.014627:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019756160:0@lo:400:kworker.0 00000100:00100000:0.0:1788851118.014650:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019756672:0@lo:400:kworker.0 00000100:00100000:2.0:1788851118.042305:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851118.042404:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824448 00000100:00100000:0.0:1788851118.042414:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824448 00000100:00100000:0.0:1788851118.042502:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 203 00000100:00100000:0.0:1788851118.042514:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8834ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+25:12424:x1875746000824448:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851118.042536:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851118.042558:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206695 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d06 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042628:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042644:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042656:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042669:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042676:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042683:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042792:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042814:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042822:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851118.042833:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788851118.042908:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042917:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042925:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042931:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851118.042935:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042944:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042955:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:0.0:1788851118.042958:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851118.042963:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042970:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b20669c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042982:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.042994:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.043001:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.043123:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851118.043126:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.043133:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.043141:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892d87409400) 00010000:00010000:0.0:1788851118.043144:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851118.043147:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.043152:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.043193:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206695 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d06 expref: 28 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.043205:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d06 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.043269:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:0.0:1788851118.043272:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851118.043281:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc600, rc 0) 00000100:00100000:0.0:1788851118.043341:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8834ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+27:12424:x1875746000824448:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 829us (1043us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788851118.043349:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 203 00000100:00080000:2.0:1788851118.043426:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851118.053499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.053547:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824576 00000100:00100000:3.0:1788851118.053558:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824576 00000100:00100000:3.0:1788851118.053621:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 204 00000100:00100000:3.0:1788851118.053631:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+27:12424:x1875746000824576:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1788851118.053697:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.053714:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.053727:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.053765:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.053773:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.053780:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.053787:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851118.053791:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.053800:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.053831:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:3.0:1788851118.053835:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851118.053841:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.053848:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851118.053915:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+27:12424:x1875746000824576:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 284us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851118.053923:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 204 00000100:00100000:0.0:1788851118.060382:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.060552:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824832 00000100:00100000:1.0:1788851118.060563:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824832 00000100:00100000:1.0:1788851118.060630:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:1.0:1788851118.060642:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+27:12424:x1875746000824832:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1788851118.060872:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+28:12424:x1875746000824832:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 231us (501us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788851118.060880:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1788851118.122378:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851118.122510:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825088 00000100:00100000:0.0:1788851118.122519:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825088 00000100:00100000:0.0:1788851118.122581:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00100000:0.0:1788851118.122593:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8838d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+28:11956:x1875746000825088:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1788851118.122620:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851118.122641:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2066bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d0d expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.122750:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.122766:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d06 expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.122776:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.122812:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d06 expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.122827:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d06 expref: 29 pid: 6534 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851118.122841:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019757184:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851118.122962:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64240 going to sleep for 11 seconds 00000100:00100000:0.0:1788851118.133614:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.133688:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825216 00000100:00100000:1.0:1788851118.133698:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825216 00010000:00010000:1.0:1788851118.133735:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d06 expref: 30 pid: 6534 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851118.133776:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 93 00000100:00100000:1.0:1788851118.133786:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+30:2408:x1875746000825216:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851118.133801:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851118.133808:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d06 expref: 30 pid: 6534 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.133820:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d06 expref: 30 pid: 6534 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.133841:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:1.0:1788851118.133846:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.133855:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.133882:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.133902:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851118.133962:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+30:2408:x1875746000825216:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 177us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.133970:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 93 00010000:00010000:3.0:1788851118.134241:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2066aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d06 expref: 29 pid: 6534 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851118.134258:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019757184:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851118.134279:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.134288:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.134295:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851118.134312:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788851118.134424:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2066bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d0d expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.134453:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d0d expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.134461:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:3.0:1788851118.134464:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851118.134466:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc400, rc 0) 00000100:00100000:3.0:1788851118.134515:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8838d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+29:11956:x1875746000825088:12345-192.168.204.27@tcp:101:bash.0 Request processed in 11925us (12146us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788851118.134523:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 205 00000100:00100000:0.0:1788851118.139274:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.139374:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825344 00000100:00100000:1.0:1788851118.139385:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825344 00000100:00100000:1.0:1788851118.139456:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00100000:1.0:1788851118.139466:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+29:11956:x1875746000825344:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1788851118.139502:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851118.139523:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b2066d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d14 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.139559:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2066db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.139574:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2066db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.139586:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2066db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.139700:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b2066d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d14 expref: 31 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.139719:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2066db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d14 expref: 30 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.139733:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:1.0:1788851118.139736:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788851118.139740:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030800, rc 0) 00000100:00100000:1.0:1788851118.139800:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+30:11956:x1875746000825344:12345-192.168.204.27@tcp:101:bash.0 Request processed in 336us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.139807:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 206 00000100:00100000:2.0:1788851118.145474:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.145571:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825600 00000100:00100000:3.0:1788851118.145582:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825600 00000100:00100000:3.0:1788851118.145657:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 207 00000100:00100000:3.0:1788851118.145670:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8834aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+30:11956:x1875746000825600:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:3.0:1788851118.145937:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.145957:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.145971:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851118.146061:0:10526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1788851118.146090:0:10526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0bcf683 reply state 00000000e1f9d18b transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.146105:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.146130:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:3.0:1788851118.146133:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851118.146138:0:10526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788851118.146186:0:10526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1788851118.146289:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8834aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+34:11956:x1875746000825600:12345-192.168.204.27@tcp:36:bash.0 Request processed in 620us (823us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788851118.146299:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 207 00000020:00080000:3.0:1788851118.146304:0:10526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788851118.150612:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.150769:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825728 00000100:00100000:3.0:1788851118.150780:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825728 00000100:00100000:3.0:1788851118.150845:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 208 00000100:00100000:3.0:1788851118.150856:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+34:11956:x1875746000825728:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851118.150878:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851118.150898:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d1b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.150957:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d1b expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.150971:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d1b expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.150988:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:3.0:1788851118.150991:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851118.150994:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9e00, rc 0) 00000100:00100000:3.0:1788851118.151138:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+35:11956:x1875746000825728:12345-192.168.204.27@tcp:101:bash.0 Request processed in 283us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851118.151155:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 208 00000100:00100000:0.0:1788851118.154892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851118.154997:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825856 00000100:00100000:2.0:1788851118.155006:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825856 00000100:00100000:2.0:1788851118.155095:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1788851118.155105:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:11956:x1875746000825856:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1788851118.155126:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851118.155149:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d22 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851118.155176:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fb3ac, atime: 0x6a9fb3aa, ctime: 0x6a9fb3ac, blocks: 0x8 00010000:00010000:2.0:1788851118.155200:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788851118.155206:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851118.155214:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d22 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851118.155234:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d22 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851118.155248:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6e00, rc 0) 00000100:00100000:2.0:1788851118.155332:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+8:11956:x1875746000825856:12345-192.168.204.27@tcp:101:bash.0 Request processed in 226us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851118.155341:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1788851118.158960:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851118.159616:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825984 00000100:00100000:0.0:1788851118.159630:0:8455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825984 00002000:00010000:0.0:1788851118.159694:0:8455:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788851118.159701:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892d88348a80 with x1875746000825984 ext(0->18446744073709551615) 00002000:00010000:0.0:1788851118.159720:0:8455:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892d88348a80. 00000100:00100000:0.0:1788851118.162688:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1788851118.162712:0:8455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000825984:12345-192.168.204.27@tcp:10:bash.0 00002000:00010000:0.0:1788851118.162975:0:8455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788851118.162980:0:8455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788851116 -> 1788851117 00002000:00010000:0.0:1788851118.162982:0:8455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788851114 -> 1788851114 00002000:00010000:0.0:1788851118.162984:0:8455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788851116 -> 1788851117 00002000:00010000:0.0:1788851118.162986:0:8455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788851118.163086:0:8455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+9:2407:x1875746000825984:12345-192.168.204.27@tcp:10:bash.0 Request processed in 385us (4134us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788851118.163093:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00002000:00010000:0.0:1788851118.163099:0:8455:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788851118.163102:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892d88348a80 with x1875746000825984 ext(0->18446744073709551615) 00002000:00010000:0.0:1788851118.163110:0:8455:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892d88348a80. 00010000:00010000:3.0:1788851118.260224:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851118.268662:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851118.268737:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826112 00000100:00100000:0.0:1788851118.268748:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826112 00000100:00100000:0.0:1788851118.268814:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 209 00000100:00100000:0.0:1788851118.268826:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+35:12438:x1875746000826112:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:0.0:1788851118.268917:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.268935:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.268947:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.268963:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.268970:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.268977:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.269079:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.269090:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.269098:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851118.269147:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.269159:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.269177:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.269185:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270717:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bda00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851118.270724:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270735:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270750:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:0.0:1788851118.270753:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851118.270759:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270767:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b2066f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270787:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270794:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270800:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270806:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851118.270824:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270831:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270838:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892d87409400) 00010000:00010000:0.0:1788851118.270841:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851118.270844:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270851:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2066fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270868:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270874:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270880:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270884:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851118.270888:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270893:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270900:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:0.0:1788851118.270903:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851118.270911:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.270917:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b206705 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851118.271061:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+35:12438:x1875746000826112:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 2233us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851118.271071:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 209 00000100:00100000:3.0:1788851118.356309:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.361418:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826368 00000100:00100000:1.0:1788851118.361433:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826368 00000100:00100000:1.0:1788851118.361659:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 210 00000100:00100000:1.0:1788851118.361670:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+35:12441:x1875746000826368:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851118.361692:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851118.361713:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b20670c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d29 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.361787:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.361802:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.361814:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.361829:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.361836:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.361866:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.361977:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206721 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.361988:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.361995:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851118.362005:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788851118.362121:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362130:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362136:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362142:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851118.362146:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362154:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362166:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:1.0:1788851118.362170:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851118.362182:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362189:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206713 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362203:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362864:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362877:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362883:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851118.362886:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362894:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362906:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851118.362909:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851118.362913:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362919:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20671a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.362973:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b20670c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d29 expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.367405:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d29 expref: 37 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.367422:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:1.0:1788851118.367425:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788851118.367429:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031400, rc 0) 00000100:00100000:1.0:1788851118.367531:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+37:12441:x1875746000826368:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 5861us (11231us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788851118.367541:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 210 00000100:00100000:2.0:1788851118.373499:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.373575:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826496 00000100:00100000:1.0:1788851118.373585:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826496 00000100:00100000:1.0:1788851118.373645:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 211 00000100:00100000:1.0:1788851118.373656:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+37:12441:x1875746000826496:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:1.0:1788851118.373732:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.373750:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d0d expref: 37 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.373760:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.373797:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d0d expref: 37 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.373811:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d0d expref: 37 pid: 6535 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851118.373840:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6536:1875746019757312:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851118.373937:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea54433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851118.376096:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6536:1875746019757312:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851118.376127:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851118.379910:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.380045:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826752 00000100:00100000:1.0:1788851118.380056:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826752 00000100:00100000:1.0:1788851118.380112:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1788851118.380122:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8834b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+38:6190:x1875746000826752:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788851118.380396:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8834b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+39:6190:x1875746000826752:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 274us (496us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788851118.380404:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:3.0:1788851118.385924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.387800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826880 00000100:00100000:1.0:1788851118.387816:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826880 00010000:00010000:1.0:1788851118.387871:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d0d expref: 39 pid: 6535 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851118.387921:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 94 00000100:00100000:1.0:1788851118.387931:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+39:2408:x1875746000826880:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851118.387949:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851118.387956:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d0d expref: 39 pid: 6535 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.387993:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d0d expref: 39 pid: 6535 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.388117:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2066c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d0d expref: 39 pid: 6535 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.388137:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:1.0:1788851118.388142:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.388152:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.388161:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.388186:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851118.389676:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+38:2408:x1875746000826880:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1736us (3753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.389690:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 94 00010000:00010000:0.0:1788851118.390168:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.390182:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.390227:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.390234:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.390242:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.390247:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851118.390252:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.390259:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.390276:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:0.0:1788851118.390280:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851118.390305:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.390312:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b20672f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851118.390384:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+37:12441:x1875746000826496:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 16730us (16905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851118.390393:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 211 00000100:00100000:0.0:1788851118.401474:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.401593:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000827136 00000100:00100000:1.0:1788851118.401604:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000827136 00000100:00100000:1.0:1788851118.401670:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:1.0:1788851118.401679:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+37:12441:x1875746000827136:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1788851118.401937:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+38:12441:x1875746000827136:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 258us (473us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788851118.401945:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:2.0:1788851118.520947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.521201:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000827392 00000100:00100000:3.0:1788851118.521212:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000827392 00000100:00100000:3.0:1788851118.521282:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 212 00000100:00100000:3.0:1788851118.521292:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+38:12452:x1875746000827392:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:3.0:1788851118.521316:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851118.521338:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206736 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d30 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521422:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521438:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521457:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521475:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521493:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521499:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521633:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20674b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521644:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20674b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521663:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20674b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851118.521673:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788851118.521751:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521759:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521767:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521773:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851118.521778:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521786:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521798:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:3.0:1788851118.521802:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851118.521806:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521824:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20673d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521838:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521845:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521852:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521858:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851118.521861:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521868:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521876:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892ea5408600) 00010000:00010000:3.0:1788851118.521879:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851118.521882:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521888:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b206744 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521928:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206736 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d30 expref: 41 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521955:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20674b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d30 expref: 40 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.521963:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:3.0:1788851118.521965:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851118.521968:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9a00, rc 0) 00000100:00100000:3.0:1788851118.523587:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+40:12452:x1875746000827392:12345-192.168.204.27@tcp:101:cat.0 Request processed in 2286us (2640us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788851118.523599:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 212 00000100:00100000:0.0:1788851118.535284:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.535396:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000827648 00000100:00100000:1.0:1788851118.535410:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000827648 00000100:00100000:1.0:1788851118.535497:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1788851118.535512:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+40:12452:x1875746000827648:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:1.0:1788851118.535938:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+41:12452:x1875746000827648:12345-192.168.204.27@tcp:35:cat.0 Request processed in 427us (666us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788851118.535952:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1788851118.554969:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.555206:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000827904 00000100:00100000:1.0:1788851118.555216:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000827904 00000100:00100000:1.0:1788851118.555285:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 213 00000100:00100000:1.0:1788851118.555295:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8834a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+41:12453:x1875746000827904:12345-192.168.204.27@tcp:36:rm.0 00010000:00010000:1.0:1788851118.555352:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788851118.555380:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9e00/0x3e0030720b2066e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d1b expref: 41 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555402:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9a00/0x3e0030720b20674b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d30 expref: 40 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555428:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b206721 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d29 expref: 39 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555442:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2066db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d14 expref: 38 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555454:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:1.0:1788851118.555459:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851118.555495:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555759:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555770:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555788:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555797:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555804:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555878:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555888:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.555896:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851118.556167:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788851118.556177:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 452615164062ns, next at 453615161585ns, rc = 0 00010000:00010000:1.0:1788851118.556223:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556233:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556253:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556262:0:6534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556269:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556276:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556301:0:6534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851118.556319:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556325:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556332:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556338:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851118.556343:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556351:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556360:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:1.0:1788851118.556363:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788851118.556373:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556380:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206767 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556398:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556404:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.556755:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851118.556763:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.556770:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851118.556773:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.556780:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.556789:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:0.0:1788851118.556792:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788851118.556795:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.556801:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20676e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.556812:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851118.556814:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851118.556823:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851118.556856:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556862:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851118.556865:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556872:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556880:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:1.0:1788851118.556883:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851118.556886:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556892:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206759 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851118.556902:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098f39f9b reply state 00000000079c0d8f transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556924:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.556931:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851118.556934:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788851118.556936:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851118.557108:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8834a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+39:12453:x1875746000827904:12345-192.168.204.27@tcp:36:rm.0 Request processed in 1812us (2146us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788851118.557118:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 213 00000100:00100000:2.0:1788851118.649144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851118.649374:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828160 00000100:00100000:0.0:1788851118.649385:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828160 00000100:00100000:0.0:1788851118.649461:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 214 00000100:00100000:0.0:1788851118.649471:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+39:12459:x1875746000828160:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1788851118.649515:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851118.649539:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b206775 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d37 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.649648:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.649664:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.649677:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.649689:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.649697:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.649704:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788851118.650109:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788851118.650600:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650612:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650634:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650670:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650678:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650686:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650693:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bcc00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851118.650697:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650707:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650719:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:0.0:1788851118.650721:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851118.650726:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650731:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bcc00/0x3e0030720b20677c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851118.650745:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b448f96 reply state 0000000047625766 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650756:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650770:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8dc9bb00) 00010000:00010000:0.0:1788851118.650772:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851118.650775:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788851118.650806:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bca00/0x3e0030720b206775 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d37 expref: 42 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650822:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d37 expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.650830:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409400) 00010000:00010000:0.0:1788851118.650832:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851118.650835:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bda00, rc 0) 00000100:00100000:0.0:1788851118.650914:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+42:12459:x1875746000828160:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1444us (1781us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788851118.650923:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 214 00000100:00100000:0.0:1788851118.661143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851118.661309:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828288 00000100:00100000:2.0:1788851118.661320:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828288 00000100:00100000:2.0:1788851118.661400:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:2.0:1788851118.661420:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000828288:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1788851118.661440:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788851118.661552:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788851118.661740:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d3e expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851118.661773:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851118.661796:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788851118.661800:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851118.661810:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d3e expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851118.661830:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d3e expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851118.661844:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6600, rc 0) 00000100:00100000:2.0:1788851118.661908:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000828288:12345-192.168.204.27@tcp:101:bash.0 Request processed in 499us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851118.661915:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:2.0:1788851118.667607:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851118.667759:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828416 00000100:00100000:0.0:1788851118.667769:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828416 00000100:00100000:0.0:1788851118.667832:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:0.0:1788851118.667841:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+8:12459:x1875746000828416:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1788851118.667859:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851118.667878:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d45 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.667912:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d3e expref: 9 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.667940:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851118.667945:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851118.667951:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.667987:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d3e expref: 9 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.668047:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d3e expref: 9 pid: 8449 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851118.668063:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1875746019757440:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851118.668176:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64240 going to sleep for 11 seconds 00000100:00100000:0.0:1788851118.675624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.675815:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828544 00000100:00100000:1.0:1788851118.675825:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828544 00010000:00010000:1.0:1788851118.675869:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d3e expref: 10 pid: 8449 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851118.675916:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:1.0:1788851118.675926:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+10:2408:x1875746000828544:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851118.675945:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851118.675971:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d3e expref: 10 pid: 8449 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.675987:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d3e expref: 10 pid: 8449 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.676064:0:7476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851118.676069:0:7476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851118.676094:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.676111:0:7476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.676153:0:7476:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851118.676168:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7476:1875746019757568:192.168.204.27@tcp:105: 00000100:00100000:1.0:1788851118.676252:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443300 going to sleep for 11 seconds 00010000:00010000:2.0:1788851118.677883:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206798 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d3e expref: 10 pid: 8449 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851118.677909:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1875746019757440:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851118.677972:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851118.678001:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bcc00, rc 0) 00000100:00100000:2.0:1788851118.678124:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+9:12459:x1875746000828416:12345-192.168.204.27@tcp:101:bash.0 Request processed in 10282us (10525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851118.678135:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:1.0:1788851118.682078:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7476:1875746019757568:192.168.204.27@tcp:105: 00010000:00010000:1.0:1788851118.682111:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851118.682189:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000828544:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 6262us (6576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.682201:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:1.0:1788851118.684035:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851118.684115:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828800 00000100:00100000:2.0:1788851118.684124:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828800 00000100:00100000:2.0:1788851118.684176:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:2.0:1788851118.684186:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+42:12459:x1875746000828800:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:2.0:1788851118.684966:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+43:12459:x1875746000828800:12345-192.168.204.27@tcp:35:bash.0 Request processed in 776us (951us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788851118.684975:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:2.0:1788851118.900876:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.901461:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828928 00000100:00100000:3.0:1788851118.901484:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828928 00000100:00100000:3.0:1788851118.901551:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:3.0:1788851118.901562:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8834a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+43:12475:x1875746000828928:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851118.901588:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851118.901611:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d4c expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.901844:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b2067ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.901858:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b2067ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.901870:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b2067ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851118.901914:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788851118.901933:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851118.901955:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b2067ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.901981:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d4c expref: 45 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.902094:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b2067ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d4c expref: 44 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.902103:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:3.0:1788851118.902106:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851118.902110:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8c00, rc 0) 00000100:00100000:3.0:1788851118.902176:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8834a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+44:12475:x1875746000828928:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 616us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851118.902183:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 215 00000100:00100000:0.0:1788851118.907199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.908630:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829184 00000100:00100000:1.0:1788851118.908642:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829184 00000100:00100000:1.0:1788851118.908809:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:1.0:1788851118.908819:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+44:12475:x1875746000829184:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851118.908840:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851118.908862:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2067b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d53 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.908995:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2067bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.909029:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2067bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.909043:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2067bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851118.909060:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788851118.909155:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2067b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d53 expref: 47 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.909173:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2067bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d53 expref: 46 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.909187:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409400) 00010000:00010000:1.0:1788851118.909190:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851118.909194:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030800, rc 0) 00000100:00100000:1.0:1788851118.909314:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+46:12475:x1875746000829184:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 495us (2124us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788851118.909321:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 216 00000100:00100000:0.0:1788851118.914513:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851118.914550:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.914805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829312 00000100:00100000:3.0:1788851118.914815:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829312 00000100:00100000:3.0:1788851118.914880:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1788851118.914890:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88152300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+46:2409:x1875746000829312:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851118.914906:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851118.914927:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b2067bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d53 expref: 46 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.914948:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409400) 00010000:00010000:3.0:1788851118.914954:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851118.915070:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88152300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+45:2409:x1875746000829312:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 181us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851118.915093:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1788851118.915187:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829568 00000100:00100000:1.0:1788851118.915191:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829568 00000100:00100000:1.0:1788851118.915228:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:1.0:1788851118.915236:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+45:12475:x1875746000829568:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851118.915254:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851118.915268:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d5a expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.915372:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.915386:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.915397:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851118.915584:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788851118.915700:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d5a expref: 48 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.915717:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d5a expref: 47 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.915725:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409400) 00010000:00010000:1.0:1788851118.915728:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788851118.915731:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030400, rc 0) 00000100:00100000:1.0:1788851118.915760:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+47:12475:x1875746000829568:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 525us (1209us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1788851118.915767:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 217 00000100:00100000:2.0:1788851118.920867:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851118.921144:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829696 00000100:00100000:0.0:1788851118.921155:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829696 00000100:00100000:0.0:1788851118.921214:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:0.0:1788851118.921225:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2409:x1875746000829696:12345-192.168.204.27@tcp:1:lfs.0 00010000:00010000:0.0:1788851118.921275:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.921296:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.921318:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851118.921322:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851118.921327:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.921362:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.921375:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 8 pid: 8450 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851118.921391:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8447:1875746019757696:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851118.921544:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851118.925378:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.925569:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829824 00000100:00100000:3.0:1788851118.925579:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829824 00002000:00100000:3.0:1788851118.925626:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff892d88348380 x1875746000829824/t0(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:184/0 lens 504/0 e 0 to 0 dl 1788851129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851118.925637:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892d88348380 with x1875746000829824 ext(0->8) 00010000:00010000:3.0:1788851118.925645:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 9 pid: 8450 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.925661:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 9 pid: 8450 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851118.925669:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff892d88348380 00000100:00100000:3.0:1788851118.925698:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1788851118.925709:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+9:2408:x1875746000829824:12345-192.168.204.27@tcp:4:lfs.0 00000100:00100000:3.0:1788851118.926737:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+11:2408:x1875746000829824:12345-192.168.204.27@tcp:4:lfs.0 Request processed in 1026us (1363us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788851118.926749:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00002000:00100000:3.0:1788851118.926758:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff892d88348380 x1875746000829824/t4294967309(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:184/0 lens 504/448 e 0 to 0 dl 1788851129 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851118.926767:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892d88348380 with x1875746000829824 ext(0->8) 00010000:00010000:3.0:1788851118.926774:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 11 pid: 8450 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.926803:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 11 pid: 8450 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851118.926811:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff892d88348380 00000100:00100000:0.0:1788851118.926915:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8447:1875746019757696:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851118.926941:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851118.929761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.929924:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829952 00000100:00100000:3.0:1788851118.929934:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829952 00010000:00010000:3.0:1788851118.929974:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 11 pid: 8450 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851118.930049:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:3.0:1788851118.930059:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+11:2410:x1875746000829952:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851118.930074:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788851118.930093:0:6519:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788851118.930096:0:6519:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788851118 00002000:00010000:3.0:1788851118.930098:0:6519:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788851118 00002000:00010000:3.0:1788851118.930100:0:6519:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788851118 00002000:00010000:3.0:1788851118.930102:0:6519:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788851118.930109:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 11 pid: 8450 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.930124:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 11 pid: 8450 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.930148:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053f5bbcf/0x3e0030720b20679f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d45 expref: 11 pid: 8450 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.930182:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851118.930187:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851118.930194:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.930205:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.930240:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851118.930339:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+10:2410:x1875746000829952:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 280us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851118.930347:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 96 00010000:00010000:0.0:1788851118.930599:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.930610:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.930633:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.930660:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.930668:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.930674:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851118.930679:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.930688:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.930701:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.930708:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002674d36b/0x3e0030720b2067de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851118.930752:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+9:2409:x1875746000829696:12345-192.168.204.27@tcp:1:lfs.0 Request processed in 9529us (9895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851118.930760:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:2.0:1788851118.933489:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.933629:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830208 00000100:00100000:3.0:1788851118.933641:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830208 00000100:00100000:3.0:1788851118.933834:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:3.0:1788851118.933846:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbb2ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+47:12475:x1875746000830208:12345-192.168.204.27@tcp:35:lfs.0 00000004:00010000:3.0:1788851118.933910:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d5a expref: 47 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851118.934139:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788851118.934170:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788851118.934628:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1788851118.934682:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.934697:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d37 expref: 51 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.934723:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.934756:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d37 expref: 51 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.934772:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d37 expref: 51 pid: 6536 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851118.934786:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6537:1875746019757824:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851118.934936:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d8685acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851118.938102:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.938238:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6537:1875746019757824:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851118.938267:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851118.938312:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830336 00000100:00100000:1.0:1788851118.938319:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830336 00010000:00010000:1.0:1788851118.938356:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d37 expref: 52 pid: 6536 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851118.938580:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:1.0:1788851118.938590:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8834bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+52:2407:x1875746000830336:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851118.938608:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851118.938615:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d37 expref: 52 pid: 6536 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.938627:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d37 expref: 52 pid: 6536 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.938661:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bda00/0x3e0030720b20678a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d37 expref: 52 pid: 6536 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.938678:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409400) 00010000:00010000:1.0:1788851118.938683:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.938692:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.938700:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851118.938726:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851118.938778:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8834bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+51:2407:x1875746000830336:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 189us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851118.938787:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 97 00010000:00010000:3.0:1788851118.939314:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.939324:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851118.939446:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:3.0:1788851118.939585:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1788851118.939684:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019757952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788851118.939784:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851118.939814:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d8685a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851118.940363:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019757952 00000100:00100000:2.0:1788851118.940372:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019757952 00000100:00100000:2.0:1788851118.940429:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788851118.940438:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6537:x1875746019757952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851118.940552:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6537:x1875746019757952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851118.940560:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788851118.941139:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019757952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788851118.941297:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:3.0:1788851118.941368:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019758080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788851118.941429:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851118.941452:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d8685ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851118.941625:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019758080 00000100:00100000:2.0:1788851118.941631:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019758080 00000100:00100000:2.0:1788851118.941678:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788851118.941685:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6537:x1875746019758080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851118.941792:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6537:x1875746019758080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (363us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788851118.941799:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788851118.941932:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6537:1875746019758080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788851118.941972:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788851118.942005:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.942046:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.942054:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.942060:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851118.942064:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.942072:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.942088:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409400) 00010000:00010000:3.0:1788851118.942092:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788851118.942096:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851118.942102:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b2067e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788851118.942190:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788851118.942262:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788851118.942274:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 453001260231ns, next at 454001258020ns, rc = 0 00000001:00080000:3.0:1788851118.942280:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:3.0:1788851118.942302:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409400) 00010000:00010000:3.0:1788851118.942305:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788851118.942312:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d5a expref: 55 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851118.942419:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbb2ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+54:12475:x1875746000830208:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 8561us (8933us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788851118.942428:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000020:00080000:3.0:1788851118.942432:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788851118.944964:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851118.945214:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830464 00000100:00100000:3.0:1788851118.945224:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830464 00000100:00100000:0.0:1788851118.945372:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 218 00000100:00100000:0.0:1788851118.945383:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8834b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+54:12475:x1875746000830464:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851118.945435:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851118.945458:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2067ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d61 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.945537:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2067ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d61 expref: 55 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.945553:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2067ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d61 expref: 55 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851118.945572:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:0.0:1788851118.945575:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851118.945579:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc400, rc 0) 00000100:00100000:0.0:1788851118.945637:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8834b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+55:12475:x1875746000830464:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 256us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851118.945644:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 218 00000100:00100000:2.0:1788851118.948351:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851118.948428:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830720 00000100:00100000:1.0:1788851118.948450:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830720 00000100:00100000:1.0:1788851118.948517:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:1.0:1788851118.948527:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+55:12475:x1875746000830720:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1788851118.948947:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+56:12475:x1875746000830720:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 420us (604us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788851118.948955:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:1.0:1788851119.028968:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851119.028994:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019758208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851119.029111:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851119.034512:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019758208 00000100:00100000:3.0:1788851119.034529:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019758208 00000100:00100000:3.0:1788851119.034672:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788851119.034683:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019758208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851119.034725:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851119.034825:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019758208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (5714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851119.034832:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788851119.034932:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019758208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851119.051399:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851119.054112:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830848 00000100:00100000:1.0:1788851119.054129:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830848 00000100:00100000:1.0:1788851119.054260:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 219 00000100:00100000:1.0:1788851119.054272:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+56:12485:x1875746000830848:12345-192.168.204.27@tcp:34:lfs.0 00010000:00010000:1.0:1788851119.054348:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.054367:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.054380:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.054392:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.054400:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.054427:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.054981:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055003:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055048:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851119.055102:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055127:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055136:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055143:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055149:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851119.055154:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055161:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055175:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:1.0:1788851119.055186:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851119.055193:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055200:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2067f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055216:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055222:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055228:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055233:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851119.055236:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055241:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055248:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851119.055251:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851119.055254:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055259:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2067fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055268:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055281:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055286:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055291:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851119.055294:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055300:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055307:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:1.0:1788851119.055309:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851119.055312:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.055317:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206801 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851119.055397:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+56:12485:x1875746000830848:12345-192.168.204.27@tcp:34:lfs.0 Request processed in 1125us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851119.055407:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 219 00000100:00100000:2.0:1788851119.121659:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851119.121742:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831104 00000100:00100000:1.0:1788851119.121755:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831104 00000100:00100000:1.0:1788851119.121828:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 220 00000100:00100000:1.0:1788851119.121839:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+56:12488:x1875746000831104:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851119.121863:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851119.121906:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206808 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d68 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.121998:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122060:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122074:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122087:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122095:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122102:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122230:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b20681d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122239:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b20681d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122247:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b20681d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851119.122258:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788851119.122344:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122362:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122369:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122375:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851119.122379:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122387:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122545:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:1.0:1788851119.122549:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851119.122554:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122561:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20680f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122576:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122583:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122588:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122594:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851119.122603:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122610:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122618:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8dc9bb00) 00010000:00010000:1.0:1788851119.122621:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851119.122624:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122630:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206816 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122670:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206808 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d68 expref: 59 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122683:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b20681d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d68 expref: 58 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.122691:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:1.0:1788851119.122693:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851119.122696:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031400, rc 0) 00000100:00100000:1.0:1788851119.122767:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+58:12488:x1875746000831104:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 930us (1132us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788851119.122776:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 220 00000100:00100000:2.0:1788851119.135670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851119.135766:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831232 00000100:00100000:0.0:1788851119.135777:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831232 00000100:00100000:0.0:1788851119.135841:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 221 00000100:00100000:0.0:1788851119.135852:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+58:12488:x1875746000831232:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1788851119.135925:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.135946:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.135959:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.136061:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.136069:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.136076:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.136082:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851119.136086:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.136094:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.136106:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:0.0:1788851119.136109:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851119.136113:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.136120:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20682b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851119.136200:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+58:12488:x1875746000831232:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 349us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851119.136208:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 221 00000100:00100000:2.0:1788851119.138373:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851119.138481:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831488 00000100:00100000:1.0:1788851119.138490:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831488 00000100:00100000:1.0:1788851119.138554:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1788851119.138562:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+58:12488:x1875746000831488:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1788851119.138797:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+59:12488:x1875746000831488:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 234us (431us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788851119.138804:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:2.0:1788851119.250983:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851119.251126:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831744 00000100:00100000:1.0:1788851119.251137:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831744 00000100:00100000:1.0:1788851119.251205:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 222 00000100:00100000:1.0:1788851119.251215:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+59:12498:x1875746000831744:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1788851119.251239:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851119.251242:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788851119.251267:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8c00/0x3e0030720b2067ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d4c expref: 59 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.251288:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:1.0:1788851119.251293:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851119.251306:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206832 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d6f expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.251421:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206839 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.251437:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.251448:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851119.251460:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788851119.251586:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b206832 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d6f expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.251618:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d6f expref: 60 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.251626:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:1.0:1788851119.251629:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851119.251631:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030400, rc 0) 00000100:00100000:1.0:1788851119.251749:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+60:12498:x1875746000831744:12345-192.168.204.27@tcp:101:bash.0 Request processed in 535us (776us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788851119.251757:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 222 00000100:00100000:2.0:1788851119.255847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851119.255933:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831872 00000100:00100000:3.0:1788851119.255945:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831872 00000100:00100000:3.0:1788851119.256045:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 223 00000100:00100000:3.0:1788851119.256057:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+60:12498:x1875746000831872:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851119.256084:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851119.256105:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206847 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d76 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.256153:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.256167:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.256180:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.256295:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206847 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d76 expref: 62 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.256315:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d76 expref: 61 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.256323:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851119.256326:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851119.256330:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9000, rc 0) 00000100:00100000:3.0:1788851119.256390:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+61:12498:x1875746000831872:12345-192.168.204.27@tcp:101:bash.0 Request processed in 335us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851119.256406:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 223 00000100:00100000:2.0:1788851119.260809:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851119.260913:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832128 00000100:00100000:3.0:1788851119.260923:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832128 00000100:00100000:3.0:1788851119.261029:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 224 00000100:00100000:3.0:1788851119.261039:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+61:12498:x1875746000832128:12345-192.168.204.27@tcp:36:bash.0 00010000:00010000:3.0:1788851119.261093:0:9543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788851119.261119:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b206839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d6f expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.261161:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b20681d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d68 expref: 60 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.261171:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851119.261176:0:9543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851119.261340:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.261356:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.261365:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851119.261419:0:9543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:3.0:1788851119.261442:0:9543:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dcb5fa9 reply state 0000000026c01832 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.261454:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.261460:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851119.261472:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851119.261475:0:9543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851119.261875:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+62:12498:x1875746000832128:12345-192.168.204.27@tcp:36:bash.0 Request processed in 837us (1074us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788851119.261883:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 224 00000020:00080000:3.0:1788851119.261889:0:9543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788851119.264212:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851119.264290:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832256 00000100:00100000:1.0:1788851119.264299:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832256 00000100:00100000:1.0:1788851119.264356:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 225 00000100:00100000:1.0:1788851119.264367:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+62:12498:x1875746000832256:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:1.0:1788851119.264391:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851119.264424:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20685c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d7d expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.264530:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.264546:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.264556:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851119.264581:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788851119.264599:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851119.264619:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.264645:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b20685c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d7d expref: 64 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.264804:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d7d expref: 63 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.264813:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:1.0:1788851119.264816:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851119.264820:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d600, rc 0) 00000100:00100000:1.0:1788851119.264877:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+63:12498:x1875746000832256:12345-192.168.204.27@tcp:101:bash.0 Request processed in 511us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851119.264884:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 225 00000100:00100000:2.0:1788851119.267275:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851119.267352:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832512 00000100:00100000:1.0:1788851119.267361:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832512 00000100:00100000:1.0:1788851119.267424:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1788851119.267434:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+63:12498:x1875746000832512:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:1.0:1788851119.267679:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+64:12498:x1875746000832512:12345-192.168.204.27@tcp:35:bash.0 Request processed in 246us (411us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788851119.267688:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00010000:00010000:3.0:1788851119.284275:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851119.329138:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851119.329240:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832640 00000100:00100000:0.0:1788851119.329251:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832640 00000100:00100000:0.0:1788851119.329309:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:0.0:1788851119.329332:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead415c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+64:12504:x1875746000832640:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851119.329356:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851119.329375:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20686a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d84 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.329447:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206871 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.329460:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.329481:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851119.329536:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788851119.329540:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851119.329558:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.329582:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20686a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d84 expref: 66 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.329601:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d84 expref: 65 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.329609:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:0.0:1788851119.329612:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851119.329615:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc200, rc 0) 00000100:00100000:0.0:1788851119.329853:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead415c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+65:12504:x1875746000832640:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 521us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851119.329868:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 226 00000100:00100000:2.0:1788851119.336637:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851119.336871:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832768 00000100:00100000:3.0:1788851119.336883:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832768 00000100:00100000:3.0:1788851119.336941:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:3.0:1788851119.336951:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+65:12504:x1875746000832768:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851119.336971:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851119.336991:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206878 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d8b expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337083:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337098:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337117:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337128:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337136:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337143:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337216:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337226:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337252:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851119.337294:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788851119.337298:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851119.337316:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337328:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337337:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337344:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337351:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337358:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851119.337363:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337372:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337385:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:3.0:1788851119.337388:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851119.337393:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337565:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20687f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337579:0:9543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337585:0:9543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337592:0:9543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337597:0:9543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851119.337600:0:9543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337607:0:9543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337615:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851119.337618:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851119.337621:0:9543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337627:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b206886 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337661:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206878 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 67 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337674:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 66 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.337688:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851119.337690:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851119.337693:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9400, rc 0) 00000100:00100000:3.0:1788851119.337792:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+66:12504:x1875746000832768:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 841us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851119.337799:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 227 00000100:00100000:2.0:1788851119.343006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851119.343131:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833024 00000100:00100000:3.0:1788851119.343141:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833024 00000100:00100000:3.0:1788851119.343200:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00100000:3.0:1788851119.343209:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+66:12504:x1875746000833024:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851119.343229:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851119.343249:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206894 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d92 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.343352:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.343367:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d7d expref: 67 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.343376:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 67 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.343385:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.343429:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 67 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.343458:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 67 pid: 9543 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851119.343483:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c95880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019758336:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851119.343603:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d7d expref: 67 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.343613:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d7d expref: 67 pid: 6536 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851119.343623:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c97480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019758464:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851119.343647:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d8685acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851119.345877:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851119.345962:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833152 00000100:00100000:3.0:1788851119.345971:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833152 00010000:00010000:3.0:1788851119.346051:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 68 pid: 9543 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851119.346094:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:3.0:1788851119.346105:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+68:2408:x1875746000833152:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851119.346121:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851119.346128:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 68 pid: 9543 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.346142:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 68 pid: 9543 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.346199:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851119.346205:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.346215:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.346222:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851119.346274:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+68:2408:x1875746000833152:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 171us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851119.346282:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:2.0:1788851119.349790:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851119.349887:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833280 00000100:00100000:0.0:1788851119.349895:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833280 00010000:00010000:0.0:1788851119.349934:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d7d expref: 68 pid: 6536 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851119.349977:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 99 00000100:00100000:0.0:1788851119.349987:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+68:2407:x1875746000833280:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851119.350002:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851119.350009:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d7d expref: 68 pid: 6536 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.350063:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d7d expref: 68 pid: 6536 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.350085:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:0.0:1788851119.350090:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.350101:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.350109:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.350128:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851119.350178:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+68:2407:x1875746000833280:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 192us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851119.350198:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 99 00010000:00010000:3.0:1788851119.350921:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.27@tcp) returned -22 from blocking AST (req@000000002940efad x1875746019758336) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 67 pid: 9543 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.350939:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b20688d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d8b expref: 67 pid: 9543 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851119.350955:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c95880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019758336:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851119.350968:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b206863 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d7d expref: 66 pid: 6536 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851119.350978:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c97480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6535:1875746019758464:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851119.351002:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851119.351009:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.351075:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.351082:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851119.351102:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788851119.351230:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206894 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d92 expref: 67 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.351246:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d92 expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.351254:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851119.351257:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851119.351260:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8e00, rc 0) 00000100:00100000:3.0:1788851119.351309:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+66:12504:x1875746000833024:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 8100us (8312us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788851119.351317:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 228 00000100:00100000:2.0:1788851119.354193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851119.354314:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833536 00000100:00100000:3.0:1788851119.354324:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833536 00000100:00100000:3.0:1788851119.354387:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1788851119.354407:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+66:12504:x1875746000833536:12345-192.168.204.27@tcp:103:lfs.0 00010000:00010000:3.0:1788851119.354423:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851119.354447:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc400/0x3e0030720b2067ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d61 expref: 66 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.354505:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851119.354511:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851119.354565:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+65:12504:x1875746000833536:12345-192.168.204.27@tcp:103:lfs.0 Request processed in 169us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851119.354573:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1788851119.356935:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851119.360616:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833664 00000100:00100000:0.0:1788851119.360632:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833664 00000100:00100000:0.0:1788851119.361282:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 229 00000100:00100000:0.0:1788851119.361294:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+65:12504:x1875746000833664:12345-192.168.204.27@tcp:58:lfs.0 00010000:00010000:0.0:1788851119.361401:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.361418:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.361430:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851119.361552:0:10526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788851119.362236:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+65:12504:x1875746000833664:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 943us (5307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851119.362244:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 229 00000100:00100000:2.0:1788851119.364423:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851119.364511:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833792 00000100:00100000:3.0:1788851119.364521:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833792 00000100:00100000:3.0:1788851119.364575:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 230 00000100:00100000:3.0:1788851119.364585:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+65:12504:x1875746000833792:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851119.364605:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851119.364625:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38d99 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.364696:0:9543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.364709:0:9543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d99 expref: 66 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.364730:0:9543:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.364744:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d99 expref: 66 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.364757:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851119.364773:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851119.364778:0:9543:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d99 expref: 66 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851119.364785:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9400, rc 0) 00000100:00100000:3.0:1788851119.364843:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+66:12504:x1875746000833792:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 259us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851119.364851:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 230 00010000:00010000:0.0:1788851120.310273:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851120.310857:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851120.310864:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851120.310894:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 4 00000040:00080000:1.0:1788851120.310904:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788851120.311626:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019758592:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851120.311799:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea54433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851120.322086:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851120.322230:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019758592:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788851120.322523:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833920 00000100:00100000:3.0:1788851120.322532:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833920 00000100:00100000:3.0:1788851120.322617:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 231 00000100:00100000:3.0:1788851120.322628:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+66:12505:x1875746000833920:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851120.322668:0:6535:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851120.322802:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+66:12505:x1875746000833920:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 176us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851120.322810:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 231 00000100:00080000:1.0:1788851120.322933:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851120.326837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.326942:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834048 00000100:00100000:0.0:1788851120.326952:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834048 00000100:00100000:0.0:1788851120.327041:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 232 00000100:00100000:0.0:1788851120.327052:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+66:12505:x1875746000834048:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788851120.327120:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327138:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327169:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327186:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327194:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327201:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327345:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327355:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327363:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851120.327409:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788851120.327413:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851120.327428:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327438:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327455:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327473:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327479:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bce00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851120.327484:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327491:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327503:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:0.0:1788851120.327506:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851120.327512:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327519:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b2068b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327535:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327542:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327548:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327615:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851120.327619:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327636:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327645:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff892d87409c00) 00010000:00010000:0.0:1788851120.327706:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851120.327710:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327721:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327737:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327744:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327750:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327756:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851120.327760:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327765:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327773:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:0.0:1788851120.327775:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851120.327778:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.327794:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851120.327877:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+66:12505:x1875746000834048:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 825us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851120.327885:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 232 00000100:00100000:2.0:1788851120.331358:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851120.331455:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834304 00000100:00100000:1.0:1788851120.331464:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834304 00000100:00100000:1.0:1788851120.331527:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 233 00000100:00100000:1.0:1788851120.331537:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+66:12505:x1875746000834304:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851120.331558:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851120.331577:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38da0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331675:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331690:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331702:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851120.331714:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788851120.331792:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331801:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331807:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331824:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851120.331828:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331836:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331848:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:1.0:1788851120.331850:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788851120.331855:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331862:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331901:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068cc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38da0 expref: 68 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331911:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:1.0:1788851120.331913:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851120.331917:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38da0 expref: 68 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.331926:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030400, rc 0) 00000100:00100000:1.0:1788851120.331985:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+67:12505:x1875746000834304:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 449us (785us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1788851120.331992:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 233 00000100:00100000:2.0:1788851120.337283:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.337367:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834432 00000100:00100000:0.0:1788851120.337379:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834432 00000100:00100000:0.0:1788851120.337440:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 234 00000100:00100000:0.0:1788851120.337460:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+67:12505:x1875746000834432:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851120.337498:0:6536:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851120.337617:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+67:12505:x1875746000834432:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 158us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851120.337624:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 234 00000100:00100000:2.0:1788851120.343663:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.343803:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834688 00000100:00100000:0.0:1788851120.343815:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834688 00000100:00100000:0.0:1788851120.343891:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:0.0:1788851120.343903:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+67:12505:x1875746000834688:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851120.343930:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851120.343933:0:10526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788851120.343978:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206871 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d84 expref: 67 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.344002:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:0.0:1788851120.344008:0:10526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851120.344084:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38da7 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788851120.344476:0:10526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788851120.344619:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.344631:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.344641:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.344692:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b2068e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38da7 expref: 69 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.344708:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38da7 expref: 68 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.344716:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892d87409c00) 00010000:00010000:0.0:1788851120.344718:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851120.344721:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc600, rc 0) 00000100:00100000:0.0:1788851120.344780:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+68:12505:x1875746000834688:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 880us (1130us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788851120.344788:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 235 00000100:00100000:2.0:1788851120.348097:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851120.349167:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834944 00000100:00100000:3.0:1788851120.349179:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834944 00000100:00100000:1.0:1788851120.349399:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:1.0:1788851120.349426:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+68:12505:x1875746000834944:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788851120.349501:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851120.349531:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc600/0x3e0030720b2068e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38da7 expref: 68 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349554:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892d87409c00) 00010000:00010000:1.0:1788851120.349565:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851120.349585:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349599:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349609:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349624:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349631:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349638:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349683:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349690:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349709:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349714:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851120.349718:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349725:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349734:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:1.0:1788851120.349737:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851120.349741:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349747:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2068f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349758:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349765:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349770:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349775:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851120.349778:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349794:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349802:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x864da9be (ffff892e8dc9be00) 00010000:00010000:1.0:1788851120.349804:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851120.349807:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.349814:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2068fd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x864da9be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851120.350552:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+67:12505:x1875746000834944:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 1126us (2460us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851120.350561:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 236 00000100:00100000:2.0:1788851120.354713:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851120.361559:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835072 00000100:00100000:3.0:1788851120.361576:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835072 00000100:00100000:3.0:1788851120.361659:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 237 00000100:00100000:3.0:1788851120.361669:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+67:12505:x1875746000835072:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851120.361688:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851120.361712:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206904 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38dae expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.361747:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.361775:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.361788:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.361905:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9200/0x3e0030720b206904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dae expref: 69 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.361927:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dae expref: 68 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.361938:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:3.0:1788851120.361941:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851120.361945:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9600, rc 0) 00000100:00100000:3.0:1788851120.362088:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+68:12505:x1875746000835072:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 420us (7385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851120.362096:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 237 00000100:00100000:2.0:1788851120.365399:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851120.365507:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835328 00000100:00100000:1.0:1788851120.365518:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835328 00000100:00100000:1.0:1788851120.365588:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00100000:1.0:1788851120.365598:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+68:12505:x1875746000835328:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788851120.365685:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.365702:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.365712:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851120.365868:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788851120.365879:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 454424864816ns, next at 455424862262ns, rc = 0 00000004:00010000:1.0:1788851120.365940:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008aff8c12 reply state 000000006725381a transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.365953:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.365962:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:1.0:1788851120.365965:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788851120.365969:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851120.366102:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+70:12505:x1875746000835328:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 504us (711us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788851120.366109:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 238 00000100:00100000:2.0:1788851120.374404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.374518:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835456 00000100:00100000:0.0:1788851120.374528:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835456 00000100:00100000:0.0:1788851120.374593:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 239 00000100:00100000:0.0:1788851120.374602:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+70:12505:x1875746000835456:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851120.374643:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851120.375741:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38db5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.375820:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38db5 expref: 71 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.375838:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38db5 expref: 71 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.375861:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:0.0:1788851120.375865:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851120.375869:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bd200, rc 0) 00000100:00100000:0.0:1788851120.375932:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+71:12505:x1875746000835456:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1330us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851120.375940:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 239 00000100:00100000:2.0:1788851120.381403:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.381518:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835584 00000100:00100000:0.0:1788851120.381528:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835584 00000100:00100000:0.0:1788851120.381610:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:0.0:1788851120.381621:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+9:2408:x1875746000835584:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788851120.381856:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+10:2408:x1875746000835584:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 237us (464us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788851120.381864:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00080000:1.0:1788851120.381942:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851120.393396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851120.393505:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835840 00000100:00100000:1.0:1788851120.393517:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835840 00000100:00100000:1.0:1788851120.393578:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:1.0:1788851120.393588:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+71:12505:x1875746000835840:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788851120.393818:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+72:12505:x1875746000835840:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 231us (431us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788851120.393826:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:3.0:1788851120.399885:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.400007:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836096 00000100:00100000:0.0:1788851120.400053:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836096 00000100:00100000:0.0:1788851120.400109:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 240 00000100:00100000:0.0:1788851120.400120:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+72:12505:x1875746000836096:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788851120.400286:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+72:12505:x1875746000836096:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 166us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851120.400295:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 240 00000100:00100000:2.0:1788851120.408698:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.408795:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836224 00000100:00100000:0.0:1788851120.408805:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836224 00000100:00100000:0.0:1788851120.408865:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00100000:0.0:1788851120.408876:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+72:12505:x1875746000836224:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851120.408896:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851120.408916:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206920 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38dbc expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.408990:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206927 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.409006:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.409059:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851120.409105:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851120.409123:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.409152:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b206920 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dbc expref: 74 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.409172:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dbc expref: 73 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.409202:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:0.0:1788851120.409205:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788851120.409209:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bce00, rc 0) 00000100:00100000:0.0:1788851120.409272:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+73:12505:x1875746000836224:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 397us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851120.409280:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 241 00000100:00100000:2.0:1788851120.414152:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.415872:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836352 00000100:00100000:0.0:1788851120.415888:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836352 00000100:00100000:0.0:1788851120.415969:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:0.0:1788851120.415980:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+10:2408:x1875746000836352:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851120.416000:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851120.416047:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38dc3 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851120.416074:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb3af, blocks: 0x0 00010000:00010000:0.0:1788851120.416095:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=454s v=(0 0) 00010000:00010000:0.0:1788851120.416100:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851120.416110:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dc3 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.416129:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dc3 expref: 11 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.416145:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bde00, rc 0) 00000100:00100000:0.0:1788851120.416231:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+11:2408:x1875746000836352:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 253us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851120.416239:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 71 00000100:00100000:2.0:1788851120.425416:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851120.425501:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836608 00000100:00100000:1.0:1788851120.425510:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836608 00000100:00100000:1.0:1788851120.425575:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00100000:1.0:1788851120.425585:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+73:12505:x1875746000836608:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788851120.425697:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+73:12505:x1875746000836608:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 114us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851120.425705:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 242 00000100:00100000:1.0:1788851120.430247:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.430349:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836736 00000100:00100000:0.0:1788851120.430359:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836736 00000100:00100000:0.0:1788851120.430425:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:0.0:1788851120.430437:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+11:12505:x1875746000836736:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851120.430468:0:8625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851120.430489:0:8625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38dca expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.430526:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dc3 expref: 12 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.430537:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851120.430541:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851120.430546:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 12 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.430594:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dc3 expref: 12 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.430610:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dc3 expref: 12 pid: 8449 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851120.430625:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1875746019758720:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851120.430758:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851120.433226:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1875746019758720:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851120.433263:0:8625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 12 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.433284:0:8625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc200, rc 0) 00000100:00100000:0.0:1788851120.433343:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+12:12505:x1875746000836736:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 2908us (3106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851120.433352:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 72 00000100:00100000:3.0:1788851120.434093:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.436501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836864 00000100:00100000:0.0:1788851120.436515:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836864 00010000:00010000:0.0:1788851120.436567:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dc3 expref: 12 pid: 8449 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851120.436619:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:0.0:1788851120.436630:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+12:2407:x1875746000836864:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851120.436646:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851120.436670:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dc3 expref: 12 pid: 8449 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.436686:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dc3 expref: 12 pid: 8449 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.436710:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddd6bd5c/0x3e0030720b20692e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dc3 expref: 12 pid: 8449 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.436748:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851120.436753:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851120.436762:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 11 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.436773:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 11 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.436811:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 11 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851120.436826:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6521:1875746019758848:192.168.204.27@tcp:105: 00000100:00100000:0.0:1788851120.436924:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851120.442337:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.442510:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6521:1875746019758848:192.168.204.27@tcp:105: 00010000:00010000:0.0:1788851120.442534:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851120.442603:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a99889d1-fa00-4984-a18e-0736ff414641+11:2407:x1875746000836864:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 5973us (8511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851120.442615:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 100 00000100:00100000:3.0:1788851120.442937:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836992 00000100:00100000:3.0:1788851120.442946:0:8455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836992 00002000:00100000:3.0:1788851120.442999:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff892ea7d67480 x1875746000836992/t0(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:186/0 lens 504/0 e 0 to 0 dl 1788851131 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851120.443009:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea7d67480 with x1875746000836992 ext(0->12) 00002000:00010000:3.0:1788851120.443045:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892ea7d67480 00000100:00100000:3.0:1788851120.443073:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:3.0:1788851120.443098:0:8455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+11:2407:x1875746000836992:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788851120.443909:0:8455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a99889d1-fa00-4984-a18e-0736ff414641+13:2407:x1875746000836992:12345-192.168.204.27@tcp:4:lhsmtool_posix.0 Request processed in 808us (1580us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788851120.443919:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00002000:00100000:3.0:1788851120.443927:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff892ea7d67480 x1875746000836992/t4294967321(0) o4->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:186/0 lens 504/448 e 0 to 0 dl 1788851131 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851120.443937:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea7d67480 with x1875746000836992 ext(0->12) 00002000:00010000:3.0:1788851120.443941:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892ea7d67480 00000100:00100000:1.0:1788851120.461849:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.461953:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000837120 00000100:00100000:0.0:1788851120.461966:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000837120 00000100:00100000:0.0:1788851120.462071:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 243 00000100:00100000:0.0:1788851120.462082:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+73:12505:x1875746000837120:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788851120.464353:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1788851120.464369:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1788851120.464424:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788851120.464459:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff892d8685a780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788851120.464464:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892ea5ad2c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff892d8685af00 00000020:00080000:2.0:1788851120.464475:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892ea5ad2b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff892d87a3e200 00000004:00080000:2.0:1788851120.464506:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788851120.464529:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff892eb6c2e300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788851120.464531:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892e83306f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff892eb6c2e9c0 00000020:00080000:2.0:1788851120.464534:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892e83306a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff892d880f9a00 00000020:00080000:2.0:1788851120.464558:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1788851120.464597:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:2.0:1788851120.464616:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788851120.464618:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019758976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788851120.464773:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019759232:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788851120.464836:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+27:12505:x1875746000837120:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 2753us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851120.464847:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 243 00010000:00010000:3.0:1788851120.467603:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467622:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467630:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467637:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851120.467643:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467650:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467670:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff892e8a8cb400) 00010000:00010000:3.0:1788851120.467673:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851120.467678:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467707:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20663a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467742:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467749:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467755:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467760:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851120.467763:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467768:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467777:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff892d87409000) 00010000:00010000:3.0:1788851120.467779:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851120.467782:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467787:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2066e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467803:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467809:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467822:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467827:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851120.467830:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467837:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467845:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851120.467847:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851120.467850:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467856:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b206760 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467886:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467893:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467899:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467904:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bdc00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851120.467907:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467922:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467930:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8dc9bb00) 00010000:00010000:3.0:1788851120.467932:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851120.467935:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467942:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bdc00/0x3e0030720b206783 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467967:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467974:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467979:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467984:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851120.467987:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.467993:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.468001:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851120.468004:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851120.468007:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.468059:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b206855 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.468073:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.468080:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.468086:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.468090:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851120.468093:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.468099:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.468108:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:3.0:1788851120.468111:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851120.468114:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.468120:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b206912 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851120.468784:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851120.469511:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019758976 00000100:00100000:3.0:1788851120.469524:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019758976 00000100:00100000:3.0:1788851120.469600:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788851120.469610:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019758976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788851120.469658:0:8449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1788851120.469685:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.469706:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d22 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.469715:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788851120.469719:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851120.469723:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.469760:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d22 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.469774:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d22 expref: 12 pid: 8450 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851120.469789:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875746019759360:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851120.469864:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d8685a0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788851120.470245:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851120.472631:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851120.472753:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851120.472769:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019759104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788851120.472816:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851120.473169:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.473464:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019759232 00000100:00100000:0.0:1788851120.473474:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019759232 00000100:00100000:0.0:1788851120.473532:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019759104 00000100:00100000:0.0:1788851120.473535:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019759104 00000100:00100000:0.0:1788851120.473554:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788851120.473563:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1875746019759232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788851120.473598:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1788851120.473635:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fb3ae, atime: 0x6a9fb3ae, ctime: 0x6a9fb3ae, blocks: 0x8 00010000:00010000:0.0:1788851120.473644:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.473663:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=454s v=(0 0) 00010000:00010000:0.0:1788851120.473668:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851120.473676:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.473693:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.473704:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.473712:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.473736:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788851120.474116:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3648:x1875746019759232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 450us (1387us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788851120.474125:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788851120.474147:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788851120.474154:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019759104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788851120.474236:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788851120.474240:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788851120 00002000:00010000:0.0:1788851120.474242:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788851120.474244:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788851119 -> 1788851120 00002000:00010000:0.0:1788851120.474246:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788851120.474276:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1875746019759104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (1460us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788851120.474283:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788851120.474657:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788851120.474700:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892e87c33b80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788851120.474709:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019759104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1788851120.474723:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892ea7d64000/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788851120.474727:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019759232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788851120.475400:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000837248 00000100:00100000:0.0:1788851120.475409:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000837248 00000100:00100000:0.0:1788851120.475457:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:0.0:1788851120.475466:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+13:2408:x1875746000837248:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788851120.476111:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851120.476123:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.476138:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bde00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851120.476144:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.476156:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.476179:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.476188:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddd6bd5c/0x3e0030720b206943 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.476214:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851120.476216:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851120.476217:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788851120.477572:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788851120.477595:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1788851120.478054:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.478215:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000837376 00000100:00100000:0.0:1788851120.478225:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000837376 00010000:00010000:0.0:1788851120.478262:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d22 expref: 14 pid: 8450 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851120.478318:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 101 00000100:00100000:0.0:1788851120.478327:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+14:2407:x1875746000837376:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851120.478396:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851120.478403:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d22 expref: 14 pid: 8450 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.478416:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d22 expref: 14 pid: 8450 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.478449:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851120.478453:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851120.478459:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.478469:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.478489:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851120.478558:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a99889d1-fa00-4984-a18e-0736ff414641+14:2407:x1875746000837376:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 231us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851120.478567:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 101 00010000:00010000:3.0:1788851120.478669:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2066f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d22 expref: 13 pid: 8450 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851120.478688:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875746019759360:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851120.478711:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.478731:0:8449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.478739:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.478749:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.478757:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.478780:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851120.478831:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851120.478839:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.478864:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851120.478869:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.478877:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.478891:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.478899:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae95532a/0x3e0030720b20693c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.478922:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851120.478924:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851120.478926:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851120.478951:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3649:x1875746019758976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9342us (10173us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788851120.478959:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:2.0:1788851120.479785:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892e87c32300/2, rc 0, transno 4294967323 00000100:00100000:2.0:1788851120.479794:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019758976:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788851120.481619:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1788851120.481633:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788851120.489264:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000837248:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 13788us (16086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851120.489279:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:2.0:1788851120.494629:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851120.494728:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000837632 00000100:00100000:3.0:1788851120.494739:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000837632 00000100:00100000:3.0:1788851120.494806:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:3.0:1788851120.494816:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+21:12505:x1875746000837632:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851120.494871:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851120.494897:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bce00/0x3e0030720b206927 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dbc expref: 21 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.494918:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:3.0:1788851120.494929:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851120.494961:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.494975:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.494985:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851120.495123:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019533e90 reply state 0000000026c01832 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.495136:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.495142:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:3.0:1788851120.495144:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851120.495147:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851120.495248:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+22:12505:x1875746000837632:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 433us (630us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1788851120.495255:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 244 00000100:00100000:1.0:1788851120.499061:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.500470:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000837760 00000100:00100000:0.0:1788851120.500487:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000837760 00000100:00100000:0.0:1788851120.500557:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:0.0:1788851120.500568:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000837760:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788851120.500722:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788851120.500727:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788851120 -> 1788851118 00002000:00010000:0.0:1788851120.500730:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788851118 00002000:00010000:0.0:1788851120.500748:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788851120 -> 1788851118 00002000:00010000:0.0:1788851120.500751:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788851120.500830:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2408:x1875746000837760:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 262us (1777us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788851120.500839:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:2.0:1788851120.506541:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851120.506656:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838016 00000100:00100000:0.0:1788851120.506667:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838016 00000100:00100000:0.0:1788851120.506736:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:0.0:1788851120.506746:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+22:12505:x1875746000838016:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788851120.506819:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.506838:0:10526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dae expref: 22 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.506847:0:10526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.506882:0:10526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dae expref: 22 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851120.506896:0:10526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dae expref: 22 pid: 9543 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851120.506911:0:10526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019759488:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851120.506989:0:10526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851120.511812:0:10526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019759488:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851120.511860:0:10526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851120.513613:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851120.514062:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838144 00000100:00100000:1.0:1788851120.514073:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838144 00010000:00010000:1.0:1788851120.514115:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dae expref: 23 pid: 9543 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851120.514163:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 102 00000100:00100000:1.0:1788851120.514174:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+23:2408:x1875746000838144:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851120.514189:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851120.514196:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dae expref: 23 pid: 9543 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.514210:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dae expref: 23 pid: 9543 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.514231:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9600/0x3e0030720b20690b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dae expref: 23 pid: 9543 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.514273:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:1.0:1788851120.514278:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.514288:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.514297:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.514337:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851120.514403:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+22:2408:x1875746000838144:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 230us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851120.514411:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 102 00010000:00010000:2.0:1788851120.515525:0:10526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.515540:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.515582:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.515589:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.515596:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.515601:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851120.515606:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.515614:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.515626:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:2.0:1788851120.515629:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788851120.515634:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.515640:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc000/0x3e0030720b206951 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851120.515715:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+21:12505:x1875746000838016:12345-192.168.204.27@tcp:55:lhsmtool_posix.0 Request processed in 8968us (9182us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788851120.515736:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 245 00000100:00100000:2.0:1788851120.519366:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851120.519412:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838272 00000100:00100000:3.0:1788851120.519427:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838272 00000100:00100000:3.0:1788851120.519505:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:3.0:1788851120.519515:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000838272:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788851120.519561:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.519580:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.519605:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851120.519610:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851120.519615:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.519662:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.519677:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 8 pid: 8625 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851120.519692:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875746019759616:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851120.519782:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d8685acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851120.523911:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.524045:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838400 00000100:00100000:2.0:1788851120.524056:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838400 00010000:00010000:2.0:1788851120.524109:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 9 pid: 8625 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851120.524156:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 103 00000100:00100000:2.0:1788851120.524167:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+9:2407:x1875746000838400:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851120.524185:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851120.524206:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 9 pid: 8625 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.524219:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 9 pid: 8625 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.524244:0:7476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851120.524248:0:7476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851120.524253:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.524263:0:7476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.524282:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851120.524342:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+9:2407:x1875746000838400:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 177us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851120.524366:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 103 00010000:00010000:3.0:1788851120.524946:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3523138/0x3e0030720b206935 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dca expref: 8 pid: 8625 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851120.524964:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875746019759616:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851120.524990:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.525205:0:8449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.525215:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.525245:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.525253:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.525261:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.525268:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851120.525272:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.525281:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.525295:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.525302:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912d2e39/0x3e0030720b206958 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851120.525374:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2407:x1875746000838272:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 5860us (6017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851120.525382:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:1.0:1788851120.532903:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.533048:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838656 00000100:00100000:2.0:1788851120.533060:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838656 00000100:00100000:2.0:1788851120.533423:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 246 00000100:00100000:2.0:1788851120.533434:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+21:12505:x1875746000838656:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788851120.533528:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.533668:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d76 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.533679:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.533778:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d76 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.533796:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d76 expref: 21 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851120.533810:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019759744:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851120.533944:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851120.542755:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851120.542856:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838784 00000100:00100000:1.0:1788851120.542865:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838784 00000100:00100000:2.0:1788851120.542879:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019759744:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851120.542906:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d76 expref: 22 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.542911:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851120.542956:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 104 00000100:00100000:1.0:1788851120.542966:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+22:2408:x1875746000838784:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851120.542982:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851120.542989:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d76 expref: 22 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.543054:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d76 expref: 22 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.543076:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9000/0x3e0030720b20684e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d76 expref: 22 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.543092:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:1.0:1788851120.543098:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d99 expref: 21 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.543110:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.543118:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.543126:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.543153:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851120.543210:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+21:2408:x1875746000838784:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 246us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851120.543219:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 104 00010000:00010000:2.0:1788851120.545777:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.545810:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.545982:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.545998:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38db5 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.546006:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.546085:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38db5 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.546102:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38db5 expref: 21 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851120.546116:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019759872:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851120.546206:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851120.552626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851120.552873:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838912 00000100:00100000:3.0:1788851120.552885:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838912 00010000:00010000:3.0:1788851120.552934:0:7476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38db5 expref: 22 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851120.552977:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00100000:3.0:1788851120.552988:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+22:2407:x1875746000838912:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851120.553004:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851120.553029:0:7476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38db5 expref: 22 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.553045:0:7476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38db5 expref: 22 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.553068:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:3.0:1788851120.553074:0:7476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.553084:0:7476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.553091:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851120.553111:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851120.553167:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+22:2407:x1875746000838912:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 181us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851120.553176:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 105 00010000:00010000:2.0:1788851120.553204:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b206919 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38db5 expref: 21 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851120.553224:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019759872:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851120.553247:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.553257:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.553278:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851120.553391:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788851120.553515:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788851120.553565:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788851120.553640:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6534:1875746019760000:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788851120.553686:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851120.553713:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851120.554140:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019760000 00000100:00100000:3.0:1788851120.554155:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019760000 00000100:00100000:3.0:1788851120.554191:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788851120.554199:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6534:x1875746019760000:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788851120.554278:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6534:x1875746019760000:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851120.554285:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788851120.554601:0:6534:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788851120.554608:0:6534:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788851120.554626:0:6534:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892e87c33b80, transno 4294967322 00000100:00100000:2.0:1788851120.554691:0:6534:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff892e87c32300 x1875746019758976/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788851136 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851120.554704:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6534:1875746019760000:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788851120.554838:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788851120.554893:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6534:1875746019760128:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788851120.554928:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851120.554947:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851120.555814:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019760128 00000100:00100000:3.0:1788851120.555824:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019760128 00000100:00100000:3.0:1788851120.555870:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788851120.555879:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6534:x1875746019760128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788851120.556004:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6534:x1875746019760128:12345-0@lo:1000:mdt00_000.0 Request processed in 126us (1075us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788851120.556034:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788851120.556195:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6534:1875746019760128:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788851120.556237:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556248:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556255:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556276:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851120.556281:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556289:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556306:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:2.0:1788851120.556309:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851120.556314:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556320:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b206966 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556345:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556352:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556358:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556362:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851120.556365:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556370:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556389:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:2.0:1788851120.556391:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851120.556398:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d99 expref: 24 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556408:0:6534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d99 expref: 24 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556417:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d99 expref: 24 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.556459:0:6534:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d99 expref: 24 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851120.556471:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019760256:192.168.204.27@tcp:105: 00000100:00100000:2.0:1788851120.556553:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851120.560134:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6534:1875746019760256:192.168.204.27@tcp:105: 00010000:00010000:2.0:1788851120.560172:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560184:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2068a9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560220:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560235:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560264:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560275:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560282:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560288:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560294:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851120.560298:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560305:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560317:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:2.0:1788851120.560319:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851120.560323:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560328:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b20696d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560339:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560345:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560357:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560361:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851120.560364:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560371:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560378:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:2.0:1788851120.560381:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788851120.560383:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.560389:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b20695f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851120.560731:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+24:12505:x1875746000838656:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 27284us (27822us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788851120.560742:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 246 00000020:00080000:2.0:1788851120.560748:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788851120.560788:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851120.560793:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851120.561514:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788851120.561525:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788851120.569596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.569660:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.569690:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839040 00000100:00100000:2.0:1788851120.569700:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839040 00000100:00100000:2.0:1788851120.569739:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839296 00000100:00100000:2.0:1788851120.569741:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839296 00000100:00100000:2.0:1788851120.569756:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1788851120.569764:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+25:12504:x1875746000839040:12345-192.168.204.27@tcp:49:lfs.0 00000100:00100000:2.0:1788851120.569894:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+25:12504:x1875746000839040:12345-192.168.204.27@tcp:49:lfs.0 Request processed in 130us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851120.569901:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1788851120.569918:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:2.0:1788851120.569923:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbb2f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+24:12505:x1875746000839296:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788851120.570188:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788851120.570222:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:2.0:1788851120.570254:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570271:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570282:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570290:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570297:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570302:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570318:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788851120.570362:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbb2f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+26:12505:x1875746000839296:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 438us (701us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788851120.570369:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000020:00080000:2.0:1788851120.570379:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788851120.570416:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851120.570422:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570430:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851120.570434:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570455:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570478:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:2.0:1788851120.570482:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788851120.570488:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.570494:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b206974 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.571704:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851120.571708:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851120.571710:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851120.583852:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851120.584264:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839552 00000100:00100000:3.0:1788851120.584274:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839552 00000100:00100000:3.0:1788851120.584337:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:3.0:1788851120.584348:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+26:12504:x1875746000839552:12345-192.168.204.27@tcp:58:lfs.0 00000040:00080000:3.0:1788851120.584556:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788851120.584656:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+26:12504:x1875746000839552:12345-192.168.204.27@tcp:58:lfs.0 Request processed in 301us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851120.584665:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 247 00000100:00100000:0.0:1788851120.632668:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.632773:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839680 00000100:00100000:2.0:1788851120.632786:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839680 00000100:00100000:2.0:1788851120.632845:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:2.0:1788851120.632855:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+26:12507:x1875746000839680:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851120.632876:0:10526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851120.632898:0:10526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20697b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38dd1 expref: -99 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.632982:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.632999:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.633010:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.633063:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.633072:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.633079:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.633158:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.633170:0:10526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d92 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.633179:0:10526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.633212:0:10526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d92 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.633238:0:10526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d92 expref: 27 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851120.633252:0:10526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019760384:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851120.633339:0:10526:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851120.636089:0:10526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10526:1875746019760384:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851120.636118:0:10526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851120.647834:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.648194:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839936 00000100:00100000:2.0:1788851120.648205:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839936 00000100:00100000:2.0:1788851120.648268:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:2.0:1788851120.648279:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+28:6190:x1875746000839936:12345-192.168.204.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788851120.648553:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+29:6190:x1875746000839936:12345-192.168.204.27@tcp:35:ldlm_bl.0 Request processed in 275us (728us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788851120.648561:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:2.0:1788851120.653552:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851120.653670:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840064 00000100:00100000:1.0:1788851120.653699:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840064 00010000:00010000:1.0:1788851120.653743:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d92 expref: 29 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851120.653791:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 106 00000100:00100000:1.0:1788851120.653802:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+29:2410:x1875746000840064:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851120.653817:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851120.653824:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d92 expref: 29 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.653838:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d92 expref: 29 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.653861:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8e00/0x3e0030720b20689b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d92 expref: 29 pid: 6535 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.653879:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:1.0:1788851120.653884:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.653895:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.653904:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.653942:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851120.654004:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a99889d1-fa00-4984-a18e-0736ff414641+28:2410:x1875746000840064:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 203us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851120.654061:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 106 00010000:00010000:2.0:1788851120.654448:0:10526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654457:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851120.654517:0:10526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788851120.654522:0:10526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851120.654541:0:10526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654556:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654580:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654588:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654595:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654601:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851120.654606:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654615:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654627:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851120.654630:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851120.654634:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654641:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b206982 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654665:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654673:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654679:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654692:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851120.654695:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654702:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654711:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff892e8db47300) 00010000:00010000:2.0:1788851120.654714:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851120.654716:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654722:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b206989 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654764:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b20697b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dd1 expref: 28 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654779:0:10526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dd1 expref: 27 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851120.654786:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:2.0:1788851120.654788:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851120.654790:0:10526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7000, rc 0) 00000100:00100000:2.0:1788851120.654837:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+27:12507:x1875746000839680:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 21983us (22182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851120.654845:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 248 00000100:00100000:2.0:1788851120.884071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.884122:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.884154:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.884183:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.884206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.884228:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851120.884255:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840320 00000100:00100000:2.0:1788851120.884264:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840320 00000100:00100000:2.0:1788851120.884320:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840832 00000100:00100000:2.0:1788851120.884323:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840832 00000100:00100000:2.0:1788851120.884342:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840704 00000100:00100000:2.0:1788851120.884344:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840704 00000100:00100000:2.0:1788851120.884362:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 336 00000100:00100000:2.0:1788851120.884372:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000840320:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851120.884454:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000840320:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 84us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851120.884462:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 336 00000100:00100000:2.0:1788851120.884481:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 337 00000100:00100000:2.0:1788851120.884487:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000840832:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851120.884510:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000840832:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851120.884516:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 337 00000100:00100000:2.0:1788851120.884526:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 338 00000100:00100000:2.0:1788851120.884531:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000840704:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851120.884548:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000840704:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 17us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851120.884554:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 338 00000100:00100000:2.0:1788851120.884577:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840192 00000100:00100000:2.0:1788851120.884580:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840192 00000100:00100000:2.0:1788851120.884600:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 394 00000100:00100000:2.0:1788851120.884605:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2408:x1875746000840192:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851120.884627:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2408:x1875746000840192:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851120.884633:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 394 00000100:00100000:1.0:1788851120.884837:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840576 00000100:00100000:1.0:1788851120.884843:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840576 00000100:00100000:1.0:1788851120.884876:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840448 00000100:00100000:1.0:1788851120.884879:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840448 00000100:00100000:1.0:1788851120.884902:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:1.0:1788851120.884909:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000840576:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851120.884939:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000840576:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851120.884945:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:1.0:1788851120.884958:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:1.0:1788851120.884964:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000840448:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851120.884987:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000840448:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851120.884993:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00080000:0.0:1788851120.885630:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851120.885635:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851120.885637:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851121.077174:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851121.077199:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019760512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851121.077274:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851121.077370:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019760512 00000100:00100000:1.0:1788851121.077379:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019760512 00000100:00100000:1.0:1788851121.079983:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788851121.080006:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019760512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851121.080065:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788851121.080146:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019760512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851121.080154:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788851121.080283:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019760512:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788851121.332722:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788851121.333721:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851121.565916:0:14777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851121.565926:0:14777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851121.565963:0:14777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 5 00000040:00080000:3.0:1788851121.565969:0:14777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788851121.591154:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851121.591163:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851121.591268:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788851121.591275:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788851121.591593:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019760640:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851121.591775:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87a416c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851121.604557:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851121.604641:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840960 00000100:00100000:0.0:1788851121.604659:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840960 00000100:00100000:0.0:1788851121.604721:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:0.0:1788851121.604731:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+28:12519:x1875746000840960:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851121.604766:0:6535:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851121.604883:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a99889d1-fa00-4984-a18e-0736ff414641+28:12519:x1875746000840960:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 152us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851121.604906:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 249 00000100:00100000:1.0:1788851121.605300:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875746019760640:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788851121.617109:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851121.617345:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841216 00000100:00100000:3.0:1788851121.617368:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841216 00000100:00100000:3.0:1788851121.617577:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:3.0:1788851121.617589:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+27:12519:x1875746000841216:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851121.617781:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851121.617805:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206997 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38dd8 expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.617925:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20699e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.617943:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20699e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.617955:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20699e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851121.617967:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788851121.618900:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b206997 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dd8 expref: 30 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.618919:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20699e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dd8 expref: 29 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.618928:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851121.618932:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851121.618935:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9c00, rc 0) 00000100:00100000:3.0:1788851121.619008:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+29:12519:x1875746000841216:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1421us (2565us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788851121.619032:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 250 00000100:00100000:0.0:1788851121.625285:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851121.625380:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851121.629725:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841472 00000100:00100000:3.0:1788851121.629750:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841472 00000100:00100000:3.0:1788851121.629827:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:3.0:1788851121.629838:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+29:12519:x1875746000841472:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788851121.629925:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.629943:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.629955:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.630128:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.630137:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.630143:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.630149:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8a00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851121.630154:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.630161:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.630173:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851121.630176:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851121.630181:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.630200:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ac lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851121.630334:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+30:12519:x1875746000841472:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 497us (5056us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788851121.630342:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 251 00000100:00100000:3.0:1788851121.630369:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841600 00000100:00100000:3.0:1788851121.630374:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841600 00000100:00100000:3.0:1788851121.630406:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:3.0:1788851121.630412:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+30:2409:x1875746000841600:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851121.630433:0:7476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:1.0:1788851121.630722:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851121.630727:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851121.631224:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788851121.631233:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788851121.634190:0:7476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b20699e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dd8 expref: 30 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851121.634215:0:7476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851121.634221:0:7476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851121.634294:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a99889d1-fa00-4984-a18e-0736ff414641+29:2409:x1875746000841600:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 3881us (8913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851121.634304:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1788851121.641852:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851121.642235:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841856 00000100:00100000:2.0:1788851121.642246:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841856 00000100:00100000:2.0:1788851121.642305:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:2.0:1788851121.642315:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+29:12519:x1875746000841856:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788851121.642575:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+30:12519:x1875746000841856:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 261us (732us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788851121.642583:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00010000:00010000:2.0:1788851122.356305:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851123.129790:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019761280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851123.129864:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851123.130287:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788851123.130297:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019760896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851123.130327:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851123.130850:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019760768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851123.130878:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851123.131083:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019761280 00000100:00100000:1.0:1788851123.131093:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019761280 00000100:00100000:1.0:1788851123.131154:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019760896 00000100:00100000:3.0:1788851123.131881:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019761792:0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.131922:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851123.131955:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019762304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.131979:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851123.132005:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788851123.132030:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019761408:0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.132083:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851123.132101:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019761920:0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.132119:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851123.132155:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019762432:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.132571:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019760896 00000100:00100000:1.0:1788851123.132680:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019760768 00000100:00100000:1.0:1788851123.132686:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019760768 00000100:00100000:1.0:1788851123.132710:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788851123.132719:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019761280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851123.132748:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788851123.132792:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019761280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851123.132809:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788851123.132826:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788851123.132832:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019760896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851123.132847:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851123.132874:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019760896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851123.132880:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788851123.133007:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851123.133076:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788851123.133082:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1788851123.133100:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892d87b8ed80, transno 4294967308 00000004:00080000:3.0:1788851123.133111:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788851123.133121:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892ea7d64000, transno 4294967311 00000100:00100000:3.0:1788851123.133146:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019760896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851123.133165:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019761280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851123.133508:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788851123.133518:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875746019760768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851123.133530:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788851123.133560:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875746019760768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851123.133566:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788851123.134050:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019760768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851123.134410:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019761792 00000100:00100000:3.0:1788851123.134417:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019761792 00000100:00100000:3.0:1788851123.134468:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788851123.134476:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019761792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.134540:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019761792:12345-0@lo:400:kworker.0 Request processed in 65us (2618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851123.134546:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788851123.134582:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019762304 00000100:00100000:3.0:1788851123.134587:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019762304 00000100:00100000:3.0:1788851123.134617:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019761408 00000100:00100000:3.0:1788851123.134620:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019761408 00000100:00100000:3.0:1788851123.134640:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019761920 00000100:00100000:3.0:1788851123.134643:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019761920 00000100:00100000:1.0:1788851123.134654:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019761792:0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.134685:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788851123.134692:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019762304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.134738:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019762304:12345-0@lo:400:kworker.0 Request processed in 46us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851123.134744:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788851123.134757:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788851123.134763:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019761408:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788851123.134786:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c97100 x1875746019762304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851123.134791:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019761408:12345-0@lo:400:kworker.0 Request processed in 28us (2708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851123.134796:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788851123.134799:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019762304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.134807:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788851123.134813:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019761920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.134814:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019761408:0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.134852:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019761920:12345-0@lo:400:kworker.0 Request processed in 39us (2730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851123.134858:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788851123.134868:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019761920:0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.134884:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019762432 00000100:00100000:3.0:1788851123.134888:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019762432 00000100:00100000:3.0:1788851123.134921:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788851123.134928:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019762432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.134964:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019762432:12345-0@lo:400:kworker.0 Request processed in 37us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851123.134969:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788851123.135082:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019761024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851123.135122:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851123.135248:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019761536:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.135286:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851123.135305:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019762048:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.135336:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851123.135358:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788851123.135365:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019761152:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.135403:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851123.135492:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019761664:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.135517:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851123.135535:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019762176:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.135554:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851123.135585:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019761024 00000100:00100000:1.0:1788851123.135590:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019761024 00000100:00100000:1.0:1788851123.135813:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788851123.135822:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019761024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851123.135836:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851123.135871:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019761024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851123.135877:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788851123.136061:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019761024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851123.137955:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019762048 00000100:00100000:3.0:1788851123.137967:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019762048 00000100:00100000:3.0:1788851123.138008:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019761664 00000100:00100000:3.0:1788851123.138031:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019761664 00000100:00100000:3.0:1788851123.138046:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019762176 00000100:00100000:3.0:1788851123.138069:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019762176 00000100:00080000:1.0:1788851123.138090:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851123.138092:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00080000:1.0:1788851123.138094:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851123.138098:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019762048:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788851123.138098:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851123.138101:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851123.138640:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019761536 00000100:00100000:0.0:1788851123.138647:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019761536 00000100:00100000:0.0:1788851123.138693:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788851123.138702:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019761536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.138912:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019762048:12345-0@lo:400:kworker.0 Request processed in 813us (3573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851123.138921:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788851123.138940:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788851123.138949:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019761664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851123.139002:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019761536:12345-0@lo:400:kworker.0 Request processed in 301us (3715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851123.139009:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788851123.139046:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019761152 00000100:00100000:0.0:1788851123.139050:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019761152 00000100:00100000:3.0:1788851123.139385:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019761664:12345-0@lo:400:kworker.0 Request processed in 436us (3865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851123.139401:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788851123.139416:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788851123.139424:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019762176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851123.139461:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019762176:12345-0@lo:400:kworker.0 Request processed in 39us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851123.139466:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788851123.139522:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019762432:0@lo:400:kworker.0 00000100:00100000:0.0:1788851123.140273:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788851123.140360:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019761152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851123.140415:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019761152:12345-0@lo:400:kworker.0 Request processed in 63us (5011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851123.140423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00010000:00080000:1.0:1788851123.143549:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7c94380 x1875746019762048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851123.143568:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019762048:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.144281:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019761152:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.144300:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019761664:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.144312:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019762176:0@lo:400:kworker.0 00000100:00100000:1.0:1788851123.144401:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019761536:0@lo:400:kworker.0 00010000:00010000:0.0:1788851123.389614:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851123.600111:0:14828:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851123.600120:0:14828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851123.600154:0:14828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788851123.600160:0:14828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788851123.801452:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851123.801541:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842112 00000100:00100000:3.0:1788851123.801551:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842112 00000100:00080000:1.0:1788851123.801642:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851123.801717:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 252 00000100:00100000:3.0:1788851123.801728:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+30:12540:x1875746000842112:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851123.801752:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851123.801771:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b2069b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ddf expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.801881:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.801910:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.801922:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851123.801934:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788851123.802096:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9c00/0x3e0030720b2069b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ddf expref: 33 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.802111:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ddf expref: 32 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.802132:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851123.802134:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788851123.802138:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8a00, rc 0) 00000100:00100000:3.0:1788851123.802218:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+32:12540:x1875746000842112:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 493us (775us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788851123.802226:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 252 00000100:00100000:2.0:1788851123.804545:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851123.804630:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842240 00000100:00100000:3.0:1788851123.804640:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842240 00000100:00100000:3.0:1788851123.804697:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 253 00000100:00100000:3.0:1788851123.804708:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+32:12540:x1875746000842240:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1788851123.804846:0:10526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.804863:0:10526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.804893:0:10526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.804929:0:10526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.804937:0:10526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.804944:0:10526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.804950:0:10526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851123.804954:0:10526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.804961:0:10526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.804974:0:10526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:3.0:1788851123.804977:0:10526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851123.804982:0:10526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851123.804989:0:10526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8600/0x3e0030720b2069c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851123.806699:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+32:12540:x1875746000842240:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 1982us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851123.806715:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 253 00000100:00100000:1.0:1788851123.934716:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851123.936203:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842368 00000100:00100000:2.0:1788851123.936216:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842368 00000100:00100000:2.0:1788851123.936435:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:2.0:1788851123.936446:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2409:x1875746000842368:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:2.0:1788851123.936464:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851123.936502:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2069cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38de6 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851123.936536:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9fb3ae, atime: 0x6a9fb3ae, ctime: 0x6a9fb3ae, blocks: 0x8 00010000:00010000:2.0:1788851123.936557:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1788851123.936562:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851123.936571:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2069cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38de6 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851123.936591:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2069cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38de6 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851123.936603:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6e00, rc 0) 00000100:00100000:2.0:1788851123.936681:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+8:2409:x1875746000842368:12345-192.168.204.27@tcp:101:cat.0 Request processed in 236us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851123.936688:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00080000:1.0:1788851123.937143:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851123.943389:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851123.943587:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842496 00000100:00100000:3.0:1788851123.943597:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842496 00002000:00100000:3.0:1788851123.943663:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff892ea7d3d880 x1875746000842496/t0(0) o3->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:189/0 lens 488/0 e 0 to 0 dl 1788851134 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851123.943693:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea7d3d880 with x1875746000842496 ext(0->4095) 00002000:00010000:3.0:1788851123.943699:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892ea7d3d880 00000100:00100000:3.0:1788851123.943735:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851123.943746:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000842496:12345-192.168.204.27@tcp:3:cat.0 00000100:00100000:3.0:1788851123.943906:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a99889d1-fa00-4984-a18e-0736ff414641+8:2407:x1875746000842496:12345-192.168.204.27@tcp:3:cat.0 Request processed in 161us (540us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788851123.943913:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00002000:00100000:3.0:1788851123.943920:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff892ea7d3d880 x1875746000842496/t0(0) o3->a99889d1-fa00-4984-a18e-0736ff414641@192.168.204.27@tcp:189/0 lens 488/4536 e 0 to 0 dl 1788851134 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851123.943927:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff892ea7d3d880 with x1875746000842496 ext(0->4095) 00002000:00010000:3.0:1788851123.943930:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff892ea7d3d880 00000100:00100000:1.0:1788851124.148495:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019762560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851124.148576:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851124.148644:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019762560 00000100:00100000:2.0:1788851124.148662:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019762560 00000100:00100000:2.0:1788851124.148726:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788851124.148736:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019762560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851124.148775:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788851124.149257:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019762560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 520us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851124.149267:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788851124.149267:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019762560:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788851124.409946:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851125.428300:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788851125.686717:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788851125.686732:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788851125.687307:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788851125.687359:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff892ea59a7d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788851125.687364:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892e83306900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff892ea59a76c0 00000020:00080000:2.0:1788851125.687367:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892e83306b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff892d87a99c00 00000020:00080000:2.0:1788851125.687388:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1788851125.687445:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851125.687456:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851125.687471:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851125.687477:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851125.687482:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851125.687491:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851125.687506:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff892ea5408600) 00010000:00010000:0.0:1788851125.687510:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851125.687514:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851125.687522:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8800/0x3e0030720b20694a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788851125.687656:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788851125.687732:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1788851126.005725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851126.005765:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851126.005955:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842624 00000100:00100000:2.0:1788851126.005967:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842624 00000100:00100000:2.0:1788851126.006045:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 396 00000100:00100000:2.0:1788851126.006054:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000842624:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851126.006119:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000842624:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 67us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851126.006126:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 396 00000100:00100000:3.0:1788851126.006804:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851126.006880:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851126.008043:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843136 00000100:00100000:1.0:1788851126.008051:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843136 00000100:00100000:1.0:1788851126.008104:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:1.0:1788851126.008113:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000843136:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851126.008166:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000843136:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 55us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851126.008173:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00080000:2.0:1788851126.008632:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851126.009178:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851126.009381:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842880 00000100:00100000:0.0:1788851126.009388:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842880 00000100:00100000:0.0:1788851126.009453:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843392 00000100:00100000:0.0:1788851126.009457:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843392 00000100:00100000:0.0:1788851126.009482:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00100000:0.0:1788851126.009491:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000842880:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851126.009544:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000842880:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 55us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851126.009550:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 345 00000100:00100000:0.0:1788851126.009565:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 346 00000100:00100000:0.0:1788851126.009572:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000843392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851126.009611:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000843392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 39us (2731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851126.009617:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 346 00000100:00080000:2.0:1788851126.009831:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851126.010617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851126.010713:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851126.012591:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842752 00000100:00100000:0.0:1788851126.012604:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842752 00000100:00100000:0.0:1788851126.012689:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843264 00000100:00100000:0.0:1788851126.012693:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843264 00000100:00100000:0.0:1788851126.012726:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 347 00000100:00100000:0.0:1788851126.012735:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+18:2410:x1875746000842752:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851126.012825:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+18:2410:x1875746000842752:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 90us (3647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851126.012833:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 347 00000100:00100000:0.0:1788851126.012850:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 348 00000100:00100000:0.0:1788851126.012857:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000843264:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851126.012881:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000843264:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851126.012887:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 348 00000100:00080000:3.0:1788851126.013509:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851126.014311:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843008 00000100:00100000:2.0:1788851126.014319:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843008 00000100:00100000:2.0:1788851126.014439:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:2.0:1788851126.014449:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000843008:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851126.014518:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000843008:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 72us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851126.014526:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00080000:3.0:1788851126.018989:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851126.197484:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019762688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851126.197638:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851126.202732:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019762688 00000100:00100000:1.0:1788851126.202749:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019762688 00000100:00100000:1.0:1788851126.202840:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788851126.202853:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019762688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851126.202896:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788851126.203688:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019762688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 837us (6048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851126.203697:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788851126.204222:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019762688:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788851126.456223:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851127.476656:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851128.245130:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019762816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851128.245208:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.245781:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019762944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851128.245932:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.245995:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019763456:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.246038:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.246060:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019763968:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.246082:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.246098:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019764480:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.246117:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.246139:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788851128.246145:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019763328:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.246165:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.246179:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019763840:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.246196:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.246209:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019764352:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.246224:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.246253:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019762816 00000100:00100000:1.0:1788851128.246259:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019762816 00000100:00100000:0.0:1788851128.246557:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019763456 00000100:00100000:0.0:1788851128.246562:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019763456 00000100:00100000:0.0:1788851128.246607:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019763840 00000100:00100000:0.0:1788851128.246611:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019763840 00000100:00100000:0.0:1788851128.246638:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019764352 00000100:00100000:0.0:1788851128.246641:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019764352 00000100:00100000:0.0:1788851128.246661:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788851128.246678:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019763456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.246739:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019763456:12345-0@lo:400:kworker.0 Request processed in 63us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851128.246747:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788851128.246764:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788851128.246771:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019763840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851128.247434:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019764864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851128.247468:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851128.247510:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019762944 00000100:00100000:3.0:1788851128.247515:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019762944 00000100:00100000:3.0:1788851128.247539:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019764864 00000100:00100000:3.0:1788851128.247542:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019764864 00000100:00100000:3.0:1788851128.247555:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788851128.247562:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019762944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788851128.247584:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788851128.247617:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019762944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851128.247622:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788851128.247636:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788851128.247642:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019764864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788851128.247656:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851128.247686:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019764864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851128.247692:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788851128.247731:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019764864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851128.248362:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019763840:12345-0@lo:400:kworker.0 Request processed in 1590us (2162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851128.248370:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788851128.248388:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788851128.248396:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019764352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.248430:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019764352:12345-0@lo:400:kworker.0 Request processed in 36us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851128.248435:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:0.0:1788851128.248463:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851128.248467:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851128.248470:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788851128.248497:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c37b80 x1875746019763840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851128.248509:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019763840:0@lo:400:kworker.0 00010000:00080000:0.0:1788851128.248520:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c37480 x1875746019764352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851128.248528:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019764352:0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.248543:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019762944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788851128.248566:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019763456:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.248954:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788851128.248962:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019762816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851128.248974:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851128.249026:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019762816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (3804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851128.249032:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788851128.249055:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019763072:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.249089:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.249121:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019763584:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.249144:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.249162:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019764096:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.249182:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.249200:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019764608:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.249218:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788851128.249419:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851128.249450:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019762816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851128.250430:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788851128.250441:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019763200:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.250480:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.250496:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019763712:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.250514:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.250528:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019764224:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.250548:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.250561:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019764736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851128.250580:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851128.250615:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019764736 00000100:00100000:1.0:1788851128.250620:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019764736 00000100:00100000:1.0:1788851128.250669:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788851128.250676:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019764736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851128.250692:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788851128.250730:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019764736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851128.250736:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788851128.250757:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019763968 00000100:00100000:1.0:1788851128.250761:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019763968 00000100:00100000:1.0:1788851128.250778:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019764480 00000100:00100000:1.0:1788851128.250780:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019764480 00000100:00100000:0.0:1788851128.250905:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019763200 00000100:00100000:0.0:1788851128.250908:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019763200 00000100:00100000:0.0:1788851128.250935:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019763712 00000100:00100000:0.0:1788851128.250937:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019763712 00000100:00100000:0.0:1788851128.250948:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019764224 00000100:00100000:0.0:1788851128.250951:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019764224 00000100:00100000:0.0:1788851128.250966:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788851128.250973:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019763200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.251010:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019763200:12345-0@lo:400:kworker.0 Request processed in 38us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851128.251038:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788851128.251051:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788851128.251057:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019763712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.251084:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019763712:12345-0@lo:400:kworker.0 Request processed in 28us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851128.251089:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788851128.251100:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788851128.251106:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019764224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.251129:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019764224:12345-0@lo:400:kworker.0 Request processed in 24us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851128.251135:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788851128.251212:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019764096 00000100:00100000:3.0:1788851128.251217:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019764096 00000100:00100000:3.0:1788851128.251248:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019764608 00000100:00100000:3.0:1788851128.251251:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019764608 00000100:00100000:3.0:1788851128.251271:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788851128.251277:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019763968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851128.251341:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019763968:12345-0@lo:400:kworker.0 Request processed in 63us (5257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851128.251347:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788851128.251358:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788851128.251364:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019764480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851128.251390:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019764480:12345-0@lo:400:kworker.0 Request processed in 27us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851128.251396:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788851128.251406:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788851128.251411:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019764096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851128.251437:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019764096:12345-0@lo:400:kworker.0 Request processed in 26us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851128.251443:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788851128.251454:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788851128.251459:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019764608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851128.251486:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019764608:12345-0@lo:400:kworker.0 Request processed in 27us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851128.251491:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788851128.256866:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019763968:0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.256885:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019764480:0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.258703:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019763328 00000100:00100000:0.0:1788851128.258723:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019763328 00000100:00100000:0.0:1788851128.258775:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019763584 00000100:00100000:0.0:1788851128.258779:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019763584 00000100:00100000:0.0:1788851128.258811:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788851128.258821:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019763328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.258916:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019763328:12345-0@lo:400:kworker.0 Request processed in 95us (12748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851128.258924:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788851128.258941:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788851128.258948:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019763584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.258982:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019763584:12345-0@lo:400:kworker.0 Request processed in 35us (9837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851128.258988:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788851128.259008:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019763072 00000100:00100000:0.0:1788851128.259030:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019763072 00000100:00100000:0.0:1788851128.259058:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1788851128.259064:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019763072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851128.259094:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019763072:12345-0@lo:400:kworker.0 Request processed in 30us (10003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851128.259099:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1788851128.259161:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019763328:0@lo:400:kworker.0 00000100:00080000:1.0:1788851128.262984:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851128.262992:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851128.263072:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019763200:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.263089:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019763712:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.263099:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019764224:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.263109:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1788851128.263114:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892e87c32300, transno 4294967323 00000004:00080000:1.0:1788851128.263128:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1788851128.263156:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019764736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851128.263167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019763072:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.263177:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019763584:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.263186:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019764096:0@lo:400:kworker.0 00000100:00100000:1.0:1788851128.263196:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019764608:0@lo:400:kworker.0 00010000:00010000:2.0:1788851128.508044:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851129.223153:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851129.223328:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843520 00000100:00100000:1.0:1788851129.223353:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843520 00000100:00100000:1.0:1788851129.223428:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 254 00000100:00100000:1.0:1788851129.223439:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+18:12193:x1875746000843520:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788851129.223559:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a99889d1-fa00-4984-a18e-0736ff414641+18:12193:x1875746000843520:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 121us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851129.223567:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 254 00000100:00080000:3.0:1788851129.224084:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851129.235318:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851129.235416:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843648 00000100:00100000:0.0:1788851129.235427:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843648 00000100:00100000:0.0:1788851129.235510:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00100000:0.0:1788851129.235522:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:12193:x1875746000843648:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788851129.235631:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a99889d1-fa00-4984-a18e-0736ff414641+5:12193:x1875746000843648:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851129.235653:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 255 00000100:00080000:3.0:1788851129.236103:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851129.258218:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851129.258949:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843904 00000100:00100000:3.0:1788851129.258962:0:6538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843904 00000100:00100000:3.0:1788851129.259058:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:3.0:1788851129.259068:0:6538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+18:12193:x1875746000843904:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788851129.259734:0:6538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a99889d1-fa00-4984-a18e-0736ff414641+19:12193:x1875746000843904:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 665us (1534us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788851129.259743:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:0.0:1788851129.268675:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019764992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851129.268761:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851129.269225:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019764992 00000100:00100000:3.0:1788851129.269234:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019764992 00000100:00100000:3.0:1788851129.269308:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788851129.269317:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019764992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851129.269350:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851129.269409:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019764992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851129.269416:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788851129.269573:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019764992:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788851129.524373:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851130.548282:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851131.123557:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851131.123725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851131.123775:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851131.123832:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844416 00000100:00100000:3.0:1788851131.123843:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844416 00000100:00100000:3.0:1788851131.123925:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:3.0:1788851131.123938:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000844416:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851131.124092:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2410:x1875746000844416:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 156us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851131.124100:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00080000:1.0:1788851131.127440:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851131.134102:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844160 00000100:00100000:0.0:1788851131.134121:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844160 00000100:00100000:3.0:1788851131.134398:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851131.134454:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851131.134615:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844032 00000100:00100000:0.0:1788851131.134621:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844032 00000100:00100000:0.0:1788851131.134656:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 398 00000100:00100000:0.0:1788851131.134665:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000844032:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851131.134742:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000844032:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 78us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851131.134750:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 398 00000100:00080000:0.0:1788851131.136358:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851131.139847:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851131.139929:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851131.141408:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844672 00000100:00100000:1.0:1788851131.141422:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844672 00000100:00100000:1.0:1788851131.141445:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844544 00000100:00100000:1.0:1788851131.141449:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844544 00000100:00100000:1.0:1788851131.141510:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:1.0:1788851131.141520:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000844544:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851131.141775:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000844544:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 255us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851131.141784:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:1.0:1788851131.141954:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844288 00000100:00100000:1.0:1788851131.141959:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844288 00000100:00100000:1.0:1788851131.141990:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 355 00000100:00100000:1.0:1788851131.141998:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+19:2410:x1875746000844160:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851131.142062:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+19:2410:x1875746000844160:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 64us (18519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851131.142189:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 355 00000100:00100000:1.0:1788851131.142209:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 356 00000100:00100000:1.0:1788851131.142216:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000844672:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851131.142265:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000844672:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 50us (18490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851131.142272:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 356 00000100:00100000:1.0:1788851131.142285:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 357 00000100:00100000:1.0:1788851131.142291:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000844288:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851131.142316:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2410:x1875746000844288:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (7862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851131.142322:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 357 00000100:00080000:1.0:1788851131.142489:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851131.142493:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851131.142496:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851131.147339:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844800 00000100:00100000:1.0:1788851131.147355:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844800 00000100:00100000:1.0:1788851131.147469:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 358 00000100:00100000:1.0:1788851131.147481:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000844800:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851131.147567:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2410:x1875746000844800:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 87us (7637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851131.147575:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 358 00000100:00080000:0.0:1788851131.148596:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851131.328687:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851131.328713:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019765120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851131.328797:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851131.328875:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019765120 00000100:00100000:1.0:1788851131.328886:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019765120 00000100:00100000:1.0:1788851131.328944:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788851131.328953:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019765120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851131.330204:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788851131.330296:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019765120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1342us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851131.330305:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788851131.333729:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019765120:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788851131.416420:0:15026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:05:29 (1788851129) 00010000:00010000:0.0:1788851131.581449:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851131.582551:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788851131.831355:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1788851131.831373:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788851131.831427:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788851131.831441:0:6566:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1788851131.892440:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851131.892463:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851131.892566:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1788851131.892573:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788851132.599665:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851133.364315:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019765248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851133.364400:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851133.364510:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019765248 00000100:00100000:0.0:1788851133.364519:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019765248 00000100:00100000:0.0:1788851133.364580:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788851133.364591:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8748a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019765248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851133.364619:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788851133.364675:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8748a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019765248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851133.364682:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788851133.364728:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019765248:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788851133.364984:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851133.365165:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019765376:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.365214:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851133.365237:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019765888:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.365263:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851133.365279:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019766400:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.365301:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851133.365320:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788851133.365326:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019765504:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.365346:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851133.365370:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019766016:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.365389:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851133.365404:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019766528:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.365420:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851133.365446:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019766400 00000100:00100000:2.0:1788851133.365451:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019766400 00000100:00100000:2.0:1788851133.365484:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019765504 00000100:00100000:2.0:1788851133.365487:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019765504 00000100:00100000:2.0:1788851133.365499:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019766016 00000100:00100000:2.0:1788851133.365501:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019766016 00000100:00100000:2.0:1788851133.365523:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019766528 00000100:00100000:2.0:1788851133.365526:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019766528 00000100:00100000:2.0:1788851133.365540:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788851133.365563:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019766400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.365600:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019766400:12345-0@lo:400:kworker.0 Request processed in 38us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851133.365606:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788851133.365620:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788851133.365625:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019765504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.365964:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019765504:12345-0@lo:400:kworker.0 Request processed in 255us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851133.365971:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788851133.365985:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788851133.365991:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019766016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.366247:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019766016:12345-0@lo:400:kworker.0 Request processed in 256us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851133.366255:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788851133.366267:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788851133.366274:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019766528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.366303:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019766528:12345-0@lo:400:kworker.0 Request processed in 30us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851133.366309:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:2.0:1788851133.366335:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851133.366339:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851133.366497:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019765504:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.366508:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019766016:0@lo:400:kworker.0 00010000:00080000:2.0:1788851133.366527:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8748b100 x1875746019766528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851133.366536:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019766528:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.366544:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019766400:0@lo:400:kworker.0 00000100:00100000:0.0:1788851133.366694:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019765376 00000100:00100000:0.0:1788851133.366699:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019765376 00000100:00100000:0.0:1788851133.366731:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788851133.366738:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019765376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851133.366773:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3649:x1875746019765376:12345-0@lo:400:kworker.0 Request processed in 36us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851133.366779:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788851133.366808:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019765888 00000100:00100000:0.0:1788851133.366811:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019765888 00000100:00100000:0.0:1788851133.366836:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788851133.366843:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019765888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851133.366877:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019765888:12345-0@lo:400:kworker.0 Request processed in 33us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851133.367149:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788851133.367171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019765632:0@lo:400:kworker.0 00000100:00100000:0.0:1788851133.367202:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019767040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851133.367227:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851133.367251:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851133.367257:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019766912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851133.367277:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851133.367304:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019767040 00000100:00100000:0.0:1788851133.367308:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019767040 00000100:00100000:0.0:1788851133.367334:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019766912 00000100:00100000:3.0:1788851133.367337:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851133.367337:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019766912 00000100:00100000:0.0:1788851133.367354:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788851133.367359:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019766144:0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.367383:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851133.367397:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019766656:0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.367416:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851133.367434:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788851133.367440:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8748aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019765760:0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.367461:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851133.367474:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019766144 00000100:00100000:3.0:1788851133.367476:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019766272:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.367478:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019766144 00000100:00100000:3.0:1788851133.367496:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851133.367503:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019765760 00000100:00100000:2.0:1788851133.367506:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019765760 00000100:00100000:3.0:1788851133.367512:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019766784:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.367522:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788851133.367528:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019766144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.367529:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851133.367555:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788851133.367562:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019765760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.367562:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019766144:12345-0@lo:400:kworker.0 Request processed in 34us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851133.367568:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00080000:2.0:1788851133.367587:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851133.367591:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851133.367594:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851133.367692:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019767040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788851133.367715:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851133.367779:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019765760:12345-0@lo:400:kworker.0 Request processed in 217us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851133.367786:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788851133.367789:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019767040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 429us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851133.367804:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788851133.367815:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788851133.367821:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019766912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851133.367831:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788851133.367854:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019766912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851133.367859:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788851133.367889:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851133.367898:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019767168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851133.367921:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851133.367943:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019767168 00000100:00100000:0.0:1788851133.367947:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019767168 00000100:00100000:0.0:1788851133.367974:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788851133.367979:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019767168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851133.367989:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851133.368034:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019767168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851133.368055:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1788851133.368071:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851133.368096:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019767168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851133.368123:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019765376:0@lo:400:kworker.0 00000100:00100000:0.0:1788851133.368135:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019765888:0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.368476:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019765632 00000100:00100000:3.0:1788851133.368482:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019765632 00000100:00100000:3.0:1788851133.368507:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788851133.368514:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019765632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.368556:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019765632:12345-0@lo:400:kworker.0 Request processed in 43us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851133.368563:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788851133.368691:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019766656 00000100:00100000:3.0:1788851133.368695:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019766656 00000100:00100000:3.0:1788851133.368720:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019766272 00000100:00100000:3.0:1788851133.368723:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019766272 00000100:00100000:3.0:1788851133.368733:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019766784 00000100:00100000:3.0:1788851133.368735:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019766784 00000100:00100000:3.0:1788851133.368747:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788851133.368753:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019766656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.368784:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019766656:12345-0@lo:400:kworker.0 Request processed in 31us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851133.368790:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788851133.368801:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788851133.368807:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019766272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.368834:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019766272:12345-0@lo:400:kworker.0 Request processed in 28us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851133.368840:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788851133.368982:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788851133.368988:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019766784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.369031:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019766784:12345-0@lo:400:kworker.0 Request processed in 43us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851133.369036:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788851133.369075:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019765760:0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.369085:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019766272:0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.369105:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019766784:0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.369114:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019765632:0@lo:400:kworker.0 00010000:00080000:3.0:1788851133.369997:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d8748bb80 x1875746019766144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851133.370032:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8748bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019766144:0@lo:400:kworker.0 00000100:00100000:3.0:1788851133.370054:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019766656:0@lo:400:kworker.0 00000100:00100000:2.0:1788851133.371434:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019767040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851133.379527:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019766912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788851133.630665:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851134.318098:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851134.318212:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844928 00000100:00100000:2.0:1788851134.318225:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844928 00000100:00100000:2.0:1788851134.318302:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00100000:2.0:1788851134.318313:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:13212:x1875746000844928:12345-192.168.204.27@tcp:101:lsof.0 00010000:00010000:2.0:1788851134.318336:0:9543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851134.318358:0:9543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2069d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ded expref: -99 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851134.318425:0:9543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2069dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851134.318453:0:9543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2069dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851134.318467:0:9543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2069dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851134.318520:0:9543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788851134.318523:0:9543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851134.318565:0:9543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2069dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851134.318596:0:9543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b2069d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ded expref: 7 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851134.318752:0:9543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2069dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ded expref: 6 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851134.318761:0:9543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8dc9b500) 00010000:00010000:2.0:1788851134.318764:0:9543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851134.318768:0:9543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6800, rc 0) 00000100:00100000:2.0:1788851134.318846:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:13212:x1875746000844928:12345-192.168.204.27@tcp:101:lsof.0 Request processed in 535us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851134.318855:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 256 00000100:00080000:0.0:1788851134.319260:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851134.388769:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851134.388793:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019767296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851134.388881:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851134.389156:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019767296 00000100:00100000:2.0:1788851134.389166:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019767296 00000100:00100000:2.0:1788851134.389239:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788851134.389249:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019767296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851134.389283:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788851134.389364:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019767296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851134.389371:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788851134.389628:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019767296:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788851134.644560:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851135.671647:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851136.251537:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851136.251596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851136.251630:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851136.251649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851136.251667:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851136.251683:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851136.251705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851136.251736:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845312 00000100:00100000:1.0:1788851136.251747:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845312 00000100:00100000:1.0:1788851136.251800:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845824 00000100:00100000:1.0:1788851136.251803:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845824 00000100:00100000:1.0:1788851136.251815:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845184 00000100:00100000:1.0:1788851136.251817:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845184 00000100:00100000:1.0:1788851136.251843:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845696 00000100:00100000:1.0:1788851136.251845:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845696 00000100:00100000:1.0:1788851136.251860:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 365 00000100:00100000:1.0:1788851136.251869:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000845312:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851136.251956:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000845312:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 87us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851136.251964:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 365 00000100:00100000:1.0:1788851136.251985:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 366 00000100:00100000:1.0:1788851136.251991:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000845824:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851136.252052:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2408:x1875746000845824:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 60us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851136.252058:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 366 00000100:00100000:1.0:1788851136.252072:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 367 00000100:00100000:1.0:1788851136.252078:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+18:2408:x1875746000845184:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851136.252101:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+18:2408:x1875746000845184:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851136.252107:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 367 00000100:00100000:1.0:1788851136.252117:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 368 00000100:00100000:1.0:1788851136.252122:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2408:x1875746000845696:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851136.252160:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2408:x1875746000845696:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851136.252166:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 368 00000100:00100000:2.0:1788851136.252478:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845056 00000100:00100000:2.0:1788851136.252484:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845056 00000100:00100000:2.0:1788851136.252521:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 400 00000100:00100000:2.0:1788851136.252528:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2408:x1875746000845056:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851136.252563:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2408:x1875746000845056:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 35us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851136.252568:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 400 00000100:00100000:3.0:1788851136.254339:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845568 00000100:00100000:3.0:1788851136.254352:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845568 00000100:00100000:3.0:1788851136.254410:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845440 00000100:00100000:3.0:1788851136.254413:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845440 00000100:00100000:3.0:1788851136.254450:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:3.0:1788851136.254460:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000845568:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851136.254526:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2408:x1875746000845568:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 68us (2895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851136.254534:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:3.0:1788851136.254549:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:3.0:1788851136.254556:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000845440:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851136.254581:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+7:2408:x1875746000845440:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851136.254587:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00080000:0.0:1788851136.255377:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851136.255384:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851136.255387:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851136.255390:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851136.438660:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019767424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851136.438750:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851136.439183:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019767424 00000100:00100000:1.0:1788851136.439192:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019767424 00000100:00100000:1.0:1788851136.439249:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788851136.439258:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019767424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851136.439293:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788851136.439363:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019767424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851136.439370:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788851136.439637:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019767424:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788851136.693032:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851137.092498:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851137.093112:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846080 00000100:00100000:2.0:1788851137.093134:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846080 00000100:00100000:2.0:1788851137.093197:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1788851137.093207:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+18:13214:x1875746000846080:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:2.0:1788851137.093513:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+19:13214:x1875746000846080:12345-192.168.204.27@tcp:35:umount.0 Request processed in 306us (1025us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788851137.093522:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000001:00080000:0.0:1788851137.098334:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000100:00100000:3.0:1788851137.099434:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851137.099977:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846336 00000100:00100000:2.0:1788851137.099988:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846336 00000100:00100000:2.0:1788851137.100086:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:2.0:1788851137.100097:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+18:13214:x1875746000846336:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:2.0:1788851137.100418:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+19:13214:x1875746000846336:12345-192.168.204.27@tcp:35:umount.0 Request processed in 321us (1000us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788851137.100427:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:1.0:1788851137.108960:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851137.109897:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846592 00000100:00100000:2.0:1788851137.109910:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846592 00000100:00100000:2.0:1788851137.109991:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1788851137.110001:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbb2d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+19:13214:x1875746000846592:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:2.0:1788851137.110287:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbb2d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+20:13214:x1875746000846592:12345-192.168.204.27@tcp:35:umount.0 Request processed in 286us (1335us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788851137.110295:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:1.0:1788851137.115098:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851137.115268:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846848 00000100:00100000:2.0:1788851137.115278:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846848 00000100:00100000:2.0:1788851137.115334:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:2.0:1788851137.115344:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+20:13214:x1875746000846848:12345-192.168.204.27@tcp:35:umount.0 00000100:00100000:2.0:1788851137.115697:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a99889d1-fa00-4984-a18e-0736ff414641+21:13214:x1875746000846848:12345-192.168.204.27@tcp:35:umount.0 Request processed in 354us (606us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788851137.115706:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:1.0:1788851137.138138:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851137.138180:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851137.138209:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851137.138319:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851137.138442:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847104 00000100:00100000:0.0:1788851137.138456:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847104 00000100:00100000:0.0:1788851137.138535:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847360 00000100:00100000:0.0:1788851137.138538:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847360 00000100:00100000:0.0:1788851137.138552:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847232 00000100:00100000:0.0:1788851137.138555:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847232 00000100:00100000:0.0:1788851137.138571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1788851137.138582:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+15:2410:x1875746000847104:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851137.138602:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851137.138627:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433ca00/0x3e0030720b2059c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38947 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851137.138648:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851137.138715:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+14:2410:x1875746000847104:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 134us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851137.138723:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1788851137.138741:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1788851137.138748:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+13:2410:x1875746000847360:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851137.138756:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851137.138766:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2155a00/0x3e0030720b205bdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a20 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851137.138797:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851137.138815:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:2410:x1875746000847360:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 68us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851137.138822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1788851137.138834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1788851137.138840:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:2410:x1875746000847232:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851137.138849:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851137.138872:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433d800/0x3e0030720b205905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38908 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851137.138881:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851137.138897:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2410:x1875746000847232:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 58us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851137.138903:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1788851137.139229:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846976 00000100:00100000:3.0:1788851137.139235:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846976 00000100:00100000:3.0:1788851137.139274:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:3.0:1788851137.139281:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2406:x1875746000846976:12345-192.168.204.27@tcp:9:umount.0 00000020:00000080:3.0:1788851137.139322:0:8447:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205ce0 00000100:00080000:3.0:1788851137.139334:0:8447:0:(import.c:65:import_set_state_nolock()) ffff892d88063000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851137.139392:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788851137.139556:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a99889d1-fa00-4984-a18e-0736ff414641+2:2406:x1875746000846976:12345-192.168.204.27@tcp:9:umount.0 Request processed in 275us (1235us total) trans 0 rc 0/0 00010000:00010000:2.0:1788851137.139564:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851137.139565:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 80 00000100:00100000:1.0:1788851137.153542:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851137.153661:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847744 00000100:00100000:2.0:1788851137.153676:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847744 00000100:00100000:2.0:1788851137.153752:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 81 00000100:00100000:2.0:1788851137.153766:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+7:2406:x1875746000847744:12345-192.168.204.27@tcp:9:umount.0 00000020:00000080:2.0:1788851137.153812:0:8449:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205f56 00000020:00010000:2.0:1788851137.153826:0:8449:0:(genops.c:1920:obd_stale_export_put()) Put export ffff892d882f8000: total 0 00000100:00080000:2.0:1788851137.153833:0:8449:0:(import.c:65:import_set_state_nolock()) ffff892d882fe000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788851137.153914:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788851137.154192:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a99889d1-fa00-4984-a18e-0736ff414641+5:2406:x1875746000847744:12345-192.168.204.27@tcp:9:umount.0 Request processed in 428us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851137.154201:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 81 00000020:00010000:3.0:1788851137.154490:0:6522:0:(genops.c:1906:obd_stale_export_get()) Get export ffff892d882f8000: total 0 00010000:00010000:3.0:1788851137.154538:0:6522:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff892d882f8000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788851137.154604:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2069cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38de6 expref: 4 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851137.154643:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20630e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c0a expref: 3 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851137.154658:0:6522:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff892d882f8000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788851137.154670:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851137.154672:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851137.154673:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851137.171620:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851137.171811:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000848768 00000100:00100000:1.0:1788851137.171826:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000848768 00000100:00100000:1.0:1788851137.171926:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 257 00000100:00100000:1.0:1788851137.171939:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+21:2406:x1875746000848768:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:1.0:1788851137.171983:0:9543:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205913 00000020:00010000:1.0:1788851137.172003:0:9543:0:(genops.c:1920:obd_stale_export_put()) Put export ffff892ea55f8800: total 0 00000100:00080000:1.0:1788851137.172009:0:9543:0:(import.c:65:import_set_state_nolock()) ffff892ea55ff800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788851137.172266:0:9543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:2.0:1788851137.172286:0:6523:0:(genops.c:1906:obd_stale_export_get()) Get export ffff892ea55f8800: total 0 00010000:00010000:2.0:1788851137.172292:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851137.172586:0:6523:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff892ea55f8800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788851137.172633:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851137.172637:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851137.172648:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8000/0x3e0030720b206672 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38cff expref: 20 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851137.172674:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a99889d1-fa00-4984-a18e-0736ff414641+20:2406:x1875746000848768:12345-192.168.204.27@tcp:39:umount.0 Request processed in 736us (1068us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788851137.172683:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 257 00010000:00010000:2.0:1788851137.172777:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:2.0:1788851137.172780:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851137.172785:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031600/0x3e0030720b205fb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38b23 expref: 18 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.172802:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:2.0:1788851137.172805:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851137.172809:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7000/0x3e0030720b206990 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38dd1 expref: 17 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.172824:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892d81099900) 00010000:00010000:2.0:1788851137.172827:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851137.172831:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b205c5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a35 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.172851:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:2.0:1788851137.172853:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788851137.172857:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b8a00/0x3e0030720b2069ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ddf expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.172871:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:2.0:1788851137.172874:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788851137.172886:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd600/0x3e0030720b2062f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c03 expref: 14 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.172902:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:2.0:1788851137.172905:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851137.172908:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd800/0x3e0030720b2061ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bbd expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.172936:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8dc9b500) 00010000:00010000:2.0:1788851137.172939:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851137.172943:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b206369 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c1f expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.172957:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff892d81099d00) 00010000:00010000:2.0:1788851137.172959:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851137.172963:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b205c3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a2e expref: 11 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.172979:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff892e8a8cba00) 00010000:00010000:2.0:1788851137.172982:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788851137.172986:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b205cb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a4a expref: 10 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.173002:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff892d87409a00) 00010000:00010000:2.0:1788851137.173005:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851137.173008:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e8a8b9400/0x3e0030720b2068b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38d99 expref: 9 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.173066:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff892e8d8f4a00) 00010000:00010000:2.0:1788851137.173074:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788851137.173080:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b206385 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38c26 expref: 8 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.173096:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff892d87409b00) 00010000:00010000:2.0:1788851137.173098:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851137.173101:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b2062cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38bf5 expref: 7 pid: 10526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851137.173113:0:6523:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff892ea55f8800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788851137.173141:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851137.173144:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851137.173146:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851137.185601:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851137.185720:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000848896 00000100:00100000:3.0:1788851137.185734:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000848896 00000100:00100000:3.0:1788851137.185822:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 258 00000100:00100000:3.0:1788851137.185836:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+5:2406:x1875746000848896:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:3.0:1788851137.185906:0:6534:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20591a 00000100:00080000:3.0:1788851137.185932:0:6534:0:(import.c:65:import_set_state_nolock()) ffff892d879de800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851137.186050:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788851137.186287:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a99889d1-fa00-4984-a18e-0736ff414641+3:2406:x1875746000848896:12345-192.168.204.27@tcp:39:umount.0 Request processed in 453us (699us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788851137.186296:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 258 00010000:00010000:2.0:1788851137.189168:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851137.717590:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851138.485412:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851138.485449:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019767680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851138.485555:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851138.485764:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019767680 00000100:00100000:0.0:1788851138.485776:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019767680 00000100:00100000:0.0:1788851138.485856:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788851138.485870:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019767680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851138.485909:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788851138.485969:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019767680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851138.485978:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788851138.486289:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851138.486338:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019767680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851138.486500:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019767552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851138.486545:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.486894:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019768064:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.486927:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.486946:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019768576:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.486971:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.486987:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019769088:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.487040:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.487059:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788851138.487065:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019767936:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.487088:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.487120:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019768448:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.487142:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.487169:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019768960:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.487192:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.487222:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019768576 00000100:00100000:1.0:1788851138.487227:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019768576 00000100:00100000:1.0:1788851138.487279:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019767936 00000100:00100000:1.0:1788851138.487282:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019767936 00000100:00100000:1.0:1788851138.487300:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019768448 00000100:00100000:1.0:1788851138.487303:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019768448 00000100:00100000:1.0:1788851138.487320:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788851138.487329:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019768576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.487377:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019768576:12345-0@lo:400:kworker.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851138.487384:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788851138.487400:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788851138.487406:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019767936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.487443:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019767936:12345-0@lo:400:kworker.0 Request processed in 38us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851138.487450:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788851138.487463:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788851138.487469:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019768448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.487497:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019768448:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851138.487502:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:1.0:1788851138.487518:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851138.487522:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851138.487530:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019768192:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.487555:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.487572:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019768704:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.487593:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851138.487733:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019768064 00000100:00100000:3.0:1788851138.487738:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019768064 00000100:00100000:3.0:1788851138.487776:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788851138.487784:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019768064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.487824:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019768064:12345-0@lo:400:kworker.0 Request processed in 43us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851138.487831:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788851138.487852:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019768192 00000100:00100000:3.0:1788851138.487855:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019768192 00000100:00100000:3.0:1788851138.487874:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788851138.487880:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019768192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.487910:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019768192:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851138.487917:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788851138.487944:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019769088 00000100:00100000:3.0:1788851138.487948:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019769088 00000100:00100000:3.0:1788851138.487980:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019768960 00000100:00100000:3.0:1788851138.487983:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019768960 00000100:00100000:3.0:1788851138.488009:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788851138.488043:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019769088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.488076:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019769088:12345-0@lo:400:kworker.0 Request processed in 35us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851138.488090:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788851138.488114:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788851138.488130:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019768960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.488165:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019768960:12345-0@lo:400:kworker.0 Request processed in 40us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851138.488171:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1788851138.488193:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851138.488206:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019768704 00000100:00100000:3.0:1788851138.488209:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019768704 00000100:00100000:1.0:1788851138.488229:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019769216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851138.488234:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788851138.488239:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019768704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.488256:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851138.488266:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019768704:12345-0@lo:400:kworker.0 Request processed in 27us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851138.488272:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:3.0:1788851138.488284:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851138.488291:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019768192:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.488301:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019768704:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.488315:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788851138.488322:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019767808:0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.488324:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019767936:0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.488334:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019768448:0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.488343:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019768960:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.488350:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851138.488352:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019768064:0@lo:400:kworker.0 00010000:00080000:3.0:1788851138.488365:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e15500 x1875746019768576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851138.488376:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019768576:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.488383:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019768320:0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.488386:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019769088:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.488405:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.488420:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019768832:0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.488448:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851138.488482:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019768832 00000100:00100000:1.0:1788851138.488485:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019768832 00000100:00100000:1.0:1788851138.488517:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788851138.488522:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019768832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851138.488556:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019768832:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851138.488561:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:1.0:1788851138.488575:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788851138.488765:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e15c00 x1875746019768832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851138.488776:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019768832:0@lo:400:kworker.0 00000100:00100000:0.0:1788851138.492673:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019767552 00000100:00100000:0.0:1788851138.492708:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019767552 00000100:00100000:0.0:1788851138.492802:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019769216 00000100:00080000:3.0:1788851138.492803:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851138.492806:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019769216 00000100:00100000:0.0:1788851138.492830:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788851138.492839:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019767552:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851138.492859:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00002000:00000024:0.0:1788851138.492870:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788851138.492871:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019769216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851138.492892:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788851138.493172:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019769344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851138.493247:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019767808 00000100:00100000:1.0:1788851138.493253:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019767808 00000100:00100000:1.0:1788851138.493288:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1788851138.493295:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019767808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.497858:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019769216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4975us (9583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851138.497879:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788851138.497991:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019768320 00000100:00100000:3.0:1788851138.498004:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019768320 00000100:00100000:3.0:1788851138.501001:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788851138.501035:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019768320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.501176:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019768320:12345-0@lo:400:kworker.0 Request processed in 146us (12768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851138.501185:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788851138.501272:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019768320:0@lo:400:kworker.0 00000100:00100000:3.0:1788851138.501302:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019769216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851138.501412:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019767552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8573us (14865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851138.501424:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788851138.501476:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019767552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851138.506462:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851138.507774:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019769344 00000100:00100000:3.0:1788851138.507791:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019769344 00000100:00100000:0.0:1788851138.508148:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788851138.508234:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019769344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788851138.508275:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788851138.508364:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019769344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 205us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851138.508419:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788851138.508686:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019769344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851138.518435:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019767808:12345-0@lo:400:kworker.0 Request processed in 25121us (30063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851138.518461:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1788851138.520496:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019767808:0@lo:400:kworker.0 00010000:00010000:2.0:1788851138.740562:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851139.511055:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019769472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851139.511168:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851139.511586:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019769472 00000100:00100000:3.0:1788851139.511606:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019769472 00000100:00100000:3.0:1788851139.511681:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788851139.511692:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019769472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851139.511739:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788851139.511808:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019769472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851139.511832:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788851139.511931:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019769472:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788851139.768786:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851140.363915:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851140.363976:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851140.364052:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851140.364152:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849152 00000100:00100000:0.0:1788851140.364166:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849152 00000100:00100000:0.0:1788851140.364246:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849024 00000100:00100000:0.0:1788851140.364250:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849024 00000100:00100000:0.0:1788851140.364264:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849280 00000100:00100000:0.0:1788851140.364267:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849280 00000100:00100000:0.0:1788851140.364285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1788851140.364305:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+12:2410:x1875746000849152:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851140.364328:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851140.364377:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031800/0x3e0030720b205a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3898d expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851140.364400:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851140.364488:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+11:2410:x1875746000849152:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 192us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851140.364497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1788851140.364518:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1788851140.364526:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+10:2410:x1875746000849024:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851140.364533:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851140.364543:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94400/0x3e0030720b205a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3895c expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851140.364552:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851140.364584:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+9:2410:x1875746000849024:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 59us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851140.364591:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1788851140.364603:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1788851140.364610:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+8:2410:x1875746000849280:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851140.364616:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851140.364625:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94800/0x3e0030720b205bd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38a19 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851140.364644:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851140.364662:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+7:2410:x1875746000849280:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 52us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851140.364668:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:1.0:1788851140.402175:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851140.402277:0:9543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849536 00000100:00100000:3.0:1788851140.402290:0:9543:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849536 00000100:00100000:3.0:1788851140.402399:0:9543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 259 00000100:00100000:3.0:1788851140.402413:0:9543:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+6:2406:x1875746000849536:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:3.0:1788851140.402471:0:9543:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205a2b 00000020:00010000:3.0:1788851140.402481:0:9543:0:(genops.c:1920:obd_stale_export_put()) Put export ffff892ea5a1c000: total 0 00000100:00080000:3.0:1788851140.402488:0:9543:0:(import.c:65:import_set_state_nolock()) ffff892ea5a1b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851140.402529:0:9543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1788851140.402765:0:9543:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2406:x1875746000849536:12345-192.168.204.27@tcp:39:umount.0 Request processed in 343us (591us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1788851140.402775:0:9543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 259 00000020:00010000:0.0:1788851140.403296:0:6522:0:(genops.c:1906:obd_stale_export_get()) Get export ffff892ea5a1c000: total 0 00010000:00010000:0.0:1788851140.403370:0:6522:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff892ea5a1c000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788851140.403416:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e8dc9b500) 00010000:00010000:0.0:1788851140.403421:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851140.403433:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6800/0x3e0030720b2069dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ded expref: 4 pid: 9543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851140.403460:0:6522:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff892ea5a1c000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788851140.403473:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851140.403475:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851140.403476:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788851140.403726:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851140.425188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851140.425304:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849664 00000100:00100000:1.0:1788851140.425344:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849664 00000100:00100000:1.0:1788851140.425464:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 260 00000100:00100000:1.0:1788851140.425477:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+5:2406:x1875746000849664:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:1.0:1788851140.425536:0:6535:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205a32 00000100:00080000:1.0:1788851140.425551:0:6535:0:(import.c:65:import_set_state_nolock()) ffff892d879dd800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788851140.425555:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:1.0:1788851140.425737:0:6535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1788851140.426042:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851140.426466:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4c53046-d9be-47e4-bc50-30ccb352d04d+3:2406:x1875746000849664:12345-192.168.204.27@tcp:39:umount.0 Request processed in 989us (1285us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788851140.426477:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 260 00000100:00100000:1.0:1788851140.566862:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851140.567165:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849920 00000100:00100000:0.0:1788851140.567179:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849920 00000100:00100000:0.0:1788851140.567263:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 402 00000100:00100000:0.0:1788851140.567276:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+7:2406:x1875746000849920:12345-192.168.204.27@tcp:251:umount.0 00000020:00000080:0.0:1788851140.567343:0:6528:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2058f0 00000020:00010000:0.0:1788851140.567354:0:6528:0:(genops.c:1920:obd_stale_export_put()) Put export ffff892d879de000: total 0 00000100:00080000:0.0:1788851140.567361:0:6528:0:(import.c:65:import_set_state_nolock()) ffff892d879db000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788851140.567450:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f94a6f02-0dd4-4eeb-8749-5cfc5798f911+3:2406:x1875746000849920:12345-192.168.204.27@tcp:251:umount.0 Request processed in 177us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851140.567460:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 402 00000020:00010000:2.0:1788851140.569943:0:6522:0:(genops.c:1906:obd_stale_export_get()) Get export ffff892d879de000: total 0 00010000:00010000:2.0:1788851140.569955:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851140.570084:0:6522:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff892d879de000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788851140.570133:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433ce00/0x3e0030720b2059c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3894e expref: 2 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851140.570172:0:6522:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff892d879de000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788851140.570186:0:6522:0:(genops.c:885:class_export_put()) final put ffff892d879de000/f94a6f02-0dd4-4eeb-8749-5cfc5798f911 00010000:00010000:2.0:1788851140.570201:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851140.570202:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851140.570204:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788851140.570730:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892d879de000/f94a6f02-0dd4-4eeb-8749-5cfc5798f911 for MGS 00000020:00000080:3.0:1788851140.570806:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d879db000 for MGS 00010000:00010000:2.0:1788851140.790003:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851141.108964:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851141.108976:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851141.109134:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788851141.109142:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788851141.559974:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019769600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851141.560112:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851141.560580:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019769600 00000100:00100000:3.0:1788851141.560593:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019769600 00000100:00100000:3.0:1788851141.560664:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788851141.560675:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019769600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851141.560719:0:13555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788851141.560810:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019769600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851141.560818:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788851141.560874:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019769600:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788851141.814474:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851141.818367:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788851142.836615:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788851143.109118:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:2.0:1788851143.109129:0:9528:0:(genops.c:885:class_export_put()) final put ffff892d88061000/a99889d1-fa00-4984-a18e-0736ff414641 00000001:00100000:0.0:1788851143.109296:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4c53046-d9be-47e4-bc50-30ccb352d04d 00000001:00080000:0.0:1788851143.109305:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1788851143.109309:0:6513:0:(genops.c:885:class_export_put()) final put ffff892ea5a1c000/f4c53046-d9be-47e4-bc50-30ccb352d04d 00000001:00100000:0.0:1788851143.109316:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000001:00080000:0.0:1788851143.109320:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788851143.109328:0:6513:0:(genops.c:885:class_export_put()) final put ffff892ea55f8800/a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:3.0:1788851143.109560:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d88061000/a99889d1-fa00-4984-a18e-0736ff414641 for lustre-OST0001 00000020:00000080:3.0:1788851143.109629:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5a1c000/f4c53046-d9be-47e4-bc50-30ccb352d04d for lustre-MDT0000 00000020:00000080:3.0:1788851143.109665:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea55f8800/a99889d1-fa00-4984-a18e-0736ff414641 for lustre-MDT0000 00000020:00000080:3.0:1788851143.109693:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d88063000 for lustre-OST0001 00000020:00000080:3.0:1788851143.109698:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea5a1b000 for lustre-MDT0000 00000020:00000080:3.0:1788851143.109701:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea55ff800 for lustre-MDT0000 00000001:00100000:3.0:1788851143.112365:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:3.0:1788851143.112375:0:8443:0:(genops.c:885:class_export_put()) final put ffff892d882f8000/a99889d1-fa00-4984-a18e-0736ff414641 00000001:00100000:0.0:1788851143.112491:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f4c53046-d9be-47e4-bc50-30ccb352d04d 00000001:00080000:0.0:1788851143.112501:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788851143.112506:0:7465:0:(genops.c:885:class_export_put()) final put ffff892d879da800/f4c53046-d9be-47e4-bc50-30ccb352d04d 00000020:00000080:2.0:1788851143.117033:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d882f8000/a99889d1-fa00-4984-a18e-0736ff414641 for lustre-OST0000 00000001:00100000:0.0:1788851143.118907:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a99889d1-fa00-4984-a18e-0736ff414641 00000001:00080000:0.0:1788851143.118922:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788851143.118928:0:7465:0:(genops.c:885:class_export_put()) final put ffff892d879dc000/a99889d1-fa00-4984-a18e-0736ff414641 00000020:00000080:1.0:1788851143.119185:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d882fe000 for lustre-OST0000 00000020:00000080:1.0:1788851143.119192:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d879da800/f4c53046-d9be-47e4-bc50-30ccb352d04d for lustre-MDT0001 00000020:00000080:1.0:1788851143.119226:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d879dc000/a99889d1-fa00-4984-a18e-0736ff414641 for lustre-MDT0001 00000020:00000080:1.0:1788851143.119249:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d879dd800 for lustre-MDT0001 00000020:00000080:1.0:1788851143.119252:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d879de800 for lustre-MDT0001 00000020:01000004:1.0:1788851143.136698:0:15222:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788851143.170215:0:15222:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788851143.170274:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.170290:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.170297:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.170318:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.170339:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788851143.170345:0:15222:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788851143.170370:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851143.170374:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788851143.170380:0:15222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788851143.170411:0:15222:0:(import.c:65:import_set_state_nolock()) ffff892eb6c20000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788851143.172870:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019769728:0@lo:39:umount.0 00000100:00100000:2.0:1788851143.172950:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851143.173422:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019769728 00000100:00100000:2.0:1788851143.173433:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019769728 00000100:00100000:2.0:1788851143.173489:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788851143.173499:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875746019769728:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788851143.173529:0:6536:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205507 00000100:00080000:2.0:1788851143.173541:0:6536:0:(import.c:65:import_set_state_nolock()) ffff892e88fa5800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788851143.173650:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851143.173660:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.173670:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebbe00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851143.173674:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.173683:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851143.173691:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851143.173697:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788851143.173699:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788851143.173703:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788851143.173704:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851143.173756:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.173779:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851143.173803:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.173810:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e9eebbe00/0x3e0030720b205998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b20599f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.173823:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851143.173825:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851143.173826:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851143.173846:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019769856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851143.173884:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851143.174573:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1875746019769728:12345-0@lo:39:umount.0 Request processed in 1074us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851143.174583:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1788851143.174594:0:6536:0:(genops.c:885:class_export_put()) final put ffff892e88fa0000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788851143.175358:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eb6c20000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788851143.175376:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019769728:0@lo:39:umount.0 00000100:00100000:3.0:1788851143.176074:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019769856 00000100:00100000:3.0:1788851143.176084:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019769856 00000100:00100000:3.0:1788851143.176166:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851143.176189:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3647:x1875746019769856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851143.176209:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851143.176234:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff95600/0x3e0030720b20599f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205998 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851143.176248:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851143.176315:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3647:x1875746019769856:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851143.176323:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851143.176384:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c5226fe-29cd-49fb-9546-e50c12b232cb:3647:1875746019769856:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788851143.176756:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88fa0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788851143.176803:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892e88fa5800 for lustre-MDT0000 00000100:00080000:0.0:1788851143.177211:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851143.177218:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788851143.177224:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788851143.178177:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178193:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178199:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178206:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178227:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851143.178232:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178257:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178263:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178269:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178281:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788851143.178287:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178294:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178301:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178307:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178315:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788851143.178319:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178325:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178340:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178346:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788851143.178346:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851143.178353:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788851143.178354:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851143.178357:0:15222:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788851143.178360:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebb200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851143.178364:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178372:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851143.178379:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851143.178384:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:01000004:0.0:1788851143.178385:0:15222:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 10000000:01000000:1.0:1788851143.178386:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788851143.178388:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000000:0.0:1788851143.178389:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788851143.178393:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851143.178398:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1788851143.178405:0:15222:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff892d876bb000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788851143.178409:0:15222:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff892ea568e000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788851143.178413:0:15222:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff892ea568d800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788851143.178417:0:15222:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff892ead295800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1788851143.178422:0:15222:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff892e83e38000) has exports, disconnecting them 00010000:00010000:1.0:1788851143.178425:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788851143.178426:0:15222:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff892d876bb000), last request at 1788851138 00010000:00010000:1.0:1788851143.178431:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1788851143.178432:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205817 00000100:00080000:0.0:1788851143.178448:0:15222:0:(import.c:65:import_set_state_nolock()) ffff892d876be000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788851143.178451:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178456:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b2059a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b2059ad expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178471:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788851143.178474:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178479:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851143.178482:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788851143.178486:0:15222:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d876bb000): rc 0 00010000:00010000:1.0:1788851143.178489:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788851143.178489:0:15222:0:(genops.c:885:class_export_put()) final put ffff892d876bb000/lustre-MDT0000-lwp-OST0001_UUID 10000000:00010000:1.0:1788851143.178495:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788851143.178497:0:15222:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff892ea568e000), last request at 1788851138 10000000:01000000:1.0:1788851143.178501:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:00000080:0.0:1788851143.178501:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2056f1 10000000:01000000:1.0:1788851143.178503:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788851143.178505:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:0.0:1788851143.178505:0:15222:0:(import.c:65:import_set_state_nolock()) ffff892ea568f800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788851143.178514:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d876bb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1788851143.178516:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178522:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851143.178536:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178547:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433d200/0x3e0030720b2058aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b2058b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788851143.178548:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d876be000 for lustre-MDT0000 00010000:00010000:1.0:1788851143.178555:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851143.178558:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788851143.178561:0:15222:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892ea568e000): rc 0 00000020:00000080:0.0:1788851143.178563:0:15222:0:(genops.c:885:class_export_put()) final put ffff892ea568e000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1788851143.178564:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851143.178567:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788851143.178570:0:15222:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff892ea568d800), last request at 1788850900 00000020:00000080:0.0:1788851143.178573:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2055ee 00010000:00010000:1.0:1788851143.178574:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788851143.178577:0:15222:0:(import.c:65:import_set_state_nolock()) ffff892ea5688000 : changing import state from FULL to CLOSED 10000000:00010000:1.0:1788851143.178580:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788851143.178584:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea568e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 10000000:01000000:1.0:1788851143.178585:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788851143.178587:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788851143.178589:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788851143.178600:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788851143.178604:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea568f800 for lustre-MDT0000 00010000:00010000:1.0:1788851143.178606:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851143.178612:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788851143.178613:0:15222:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892ea568d800): rc 0 00000020:00000080:0.0:1788851143.178615:0:15222:0:(genops.c:885:class_export_put()) final put ffff892ea568d800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1788851143.178619:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433c600/0x3e0030720b205c0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205c15 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788851143.178622:0:15222:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff892ead295800), last request at 1788850900 00000020:00000080:0.0:1788851143.178625:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2055af 00000100:00080000:0.0:1788851143.178628:0:15222:0:(import.c:65:import_set_state_nolock()) ffff892ea556e800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788851143.178634:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea568d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1788851143.178638:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851143.178641:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178646:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2155600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851143.178649:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178655:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788851143.178656:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea5688000 for lustre-MDT0000 10000000:00010000:1.0:1788851143.178661:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788851143.178664:0:15222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 10000000:01000000:1.0:1788851143.178666:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788851143.178668:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788851143.178670:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788851143.178681:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178686:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851143.178692:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178697:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ec2155600/0x3e0030720b205466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b20546d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.178705:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851143.178707:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851143.178713:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851143.178729:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019769984:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788851143.178748:0:15222:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892ead295800): rc 0 00000004:00000080:0.0:1788851143.178754:0:15222:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa99041b1fae0 00000100:00080000:0.0:1788851143.178773:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788851143.178776:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1788851143.178809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851143.178867:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851143.178873:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019770368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851143.178891:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851143.178915:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019770112:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788851143.179626:0:15222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788851143.179644:0:15222:0:(import.c:65:import_set_state_nolock()) ffff892ead296800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788851143.179675:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019770496:0@lo:39:umount.0 00000100:00100000:0.0:1788851143.179712:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851143.179812:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019770496 00000100:00100000:0.0:1788851143.179819:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019770496 00000100:00100000:0.0:1788851143.179859:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788851143.179868:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875746019770496:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788851143.179901:0:6540:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205649 00000100:00080000:0.0:1788851143.179908:0:6540:0:(import.c:65:import_set_state_nolock()) ffff892ead296000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851143.179924:0:6540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1788851143.181414:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851143.184586:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851143.184666:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851143.184679:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019770240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851143.184743:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851143.184785:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019769984 00000100:00100000:1.0:1788851143.184793:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019769984 00000100:00100000:1.0:1788851143.184850:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019770368 00000100:00100000:1.0:1788851143.184853:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019770368 00000100:00100000:1.0:1788851143.184866:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019770112 00000100:00100000:1.0:1788851143.184868:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019770112 00000100:00100000:1.0:1788851143.184880:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019770240 00000100:00100000:1.0:1788851143.184882:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019770240 00000100:00100000:1.0:1788851143.184897:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788851143.184905:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+26:3648:x1875746019769984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851143.184920:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851143.184940:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6a00/0x3e0030720b2059ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b2059a6 expref: 26 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.184958:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851143.185027:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+25:3648:x1875746019769984:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (6192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851143.185036:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788851143.185068:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788851143.185074:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+24:3648:x1875746019770368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851143.185082:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851143.185092:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827eb400/0x3e0030720b20546d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205466 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.185102:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851143.185126:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+23:3648:x1875746019770368:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (6233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851143.185132:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788851143.185144:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788851143.185150:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+22:3649:x1875746019770112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851143.185156:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851143.185164:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433d000/0x3e0030720b2058b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b2058aa expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851143.185172:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851143.185197:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c5226fe-29cd-49fb-9546-e50c12b232cb+21:3649:x1875746019770112:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851143.185203:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788851143.185207:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788851143.185216:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+20:3649:x1875746019770240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851143.185225:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851143.185234:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94600/0x3e0030720b205c15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205c0e expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851143.185243:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851143.185244:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019770368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851143.185252:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019769984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851143.185265:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:3649:x1875746019770240:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851143.185270:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788851143.185274:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788851143.185572:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788851143.185577:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788851143.185598:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788851143.185657:0:15222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788851143.185677:0:15222:0:(import.c:65:import_set_state_nolock()) ffff892ea5b98800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788851143.185699:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788851143.185701:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788851143.185710:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788851143.185779:0:15222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788851143.185787:0:15222:0:(import.c:65:import_set_state_nolock()) ffff892d85c50000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788851143.185815:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff892e83e38000) has no exports 00000100:00100000:0.0:1788851143.198543:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019770624:0@lo:9:umount.0 00000100:00100000:0.0:1788851143.198642:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851143.198686:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019770752:0@lo:9:umount.0 00000100:00100000:0.0:1788851143.198707:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851143.198753:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019770624 00000100:00100000:0.0:1788851143.198761:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019770624 00000100:00100000:0.0:1788851143.198812:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019770752 00000100:00100000:0.0:1788851143.198815:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019770752 00000100:00100000:0.0:1788851143.198835:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788851143.198843:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875746019770624:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788851143.198873:0:8449:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205799 00000100:00080000:0.0:1788851143.198883:0:8449:0:(import.c:65:import_set_state_nolock()) ffff892ea576b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851143.198933:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788851143.199125:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3646:x1875746019770624:12345-0@lo:9:umount.0 Request processed in 282us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851143.199133:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788851143.199149:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788851143.199155:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875746019770752:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788851143.199170:0:8449:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2058db 00000100:00080000:0.0:1788851143.199430:0:8449:0:(import.c:65:import_set_state_nolock()) ffff892d879a3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851143.199466:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788851143.199552:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3646:x1875746019770752:12345-0@lo:9:umount.0 Request processed in 397us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851143.199560:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788851143.199596:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851143.199600:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788851143.199614:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851143.199643:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5b98800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788851143.199656:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788851143.199658:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851143.199661:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019770624:0@lo:9:umount.0 00000100:00080000:0.0:1788851143.199671:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c50000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788851143.199680:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788851143.199681:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851143.199683:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019770752:0@lo:9:umount.0 00000100:00100000:1.0:1788851143.199705:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019770240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851143.199716:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019770112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851143.199777:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3646:x1875746019770496:12345-0@lo:39:umount.0 Request processed in 19909us (20063us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788851143.199785:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1788851143.199812:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ead296800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788851143.199817:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019770496:0@lo:39:umount.0 00010000:00010000:2.0:1788851143.199865:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788851143.220581:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff892e83e38000) has no exports 00000020:00000080:2.0:1788851143.318188:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2054c1 00000020:00000080:2.0:1788851143.318203:0:15222:0:(genops.c:885:class_export_put()) final put ffff892ea435c800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788851143.319345:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788851143.319470:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea435c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788851143.319505:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851143.319518:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788851143.319523:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff892ec1ca3380) has no exports 00000020:00000080:3.0:1788851143.320254:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2054ba 00000020:00000080:3.0:1788851143.320263:0:15222:0:(genops.c:885:class_export_put()) final put ffff892ea42ef800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851143.320322:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea42ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788851143.320505:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851143.320515:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788851143.320531:0:15222:0:(genops.c:885:class_export_put()) final put ffff892ea42e9000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788851143.320533:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea42e9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788851143.320539:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1788851143.604724:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019771136:0@lo:400:kworker.0 00000100:00100000:1.0:1788851143.604814:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851143.604875:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019771648:0@lo:400:kworker.0 00000100:00100000:1.0:1788851143.604898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851143.604925:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788851143.604931:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019771008:0@lo:400:kworker.0 00000100:00100000:1.0:1788851143.604951:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851143.604969:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019771520:0@lo:400:kworker.0 00000100:00100000:1.0:1788851143.604988:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851143.605062:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019771136 00000100:00100000:1.0:1788851143.605071:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019771136 00000100:00100000:1.0:1788851143.605111:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019771648 00000100:00100000:1.0:1788851143.605114:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019771648 00000100:00100000:1.0:1788851143.605141:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019771008 00000100:00100000:1.0:1788851143.605144:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019771008 00000100:00100000:1.0:1788851143.605152:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019771520 00000100:00100000:1.0:1788851143.605154:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019771520 00000100:00100000:1.0:1788851143.605165:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788851143.605174:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019771648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851143.605223:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019771648:12345-0@lo:400:kworker.0 Request processed in 51us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851143.605229:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788851143.605244:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788851143.605248:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875746019771136:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788851143.605253:0:10526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788851143.605294:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875746019771136:12345-0@lo:400:kworker.0 Request processed in 44us (480us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788851143.605300:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788851143.605313:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788851143.605316:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875746019771008:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788851143.605320:0:10526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788851143.605340:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875746019771008:12345-0@lo:400:kworker.0 Request processed in 23us (389us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788851143.605346:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788851143.605357:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788851143.605360:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875746019771520:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788851143.605364:0:10526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788851143.605385:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1875746019771520:12345-0@lo:400:kworker.0 Request processed in 23us (396us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788851143.605390:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1788851143.605413:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851143.605441:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788851143.605446:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892ea568a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788851143.605450:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788851143.607405:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019771264:0@lo:400:kworker.0 00000100:00100000:3.0:1788851143.607480:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851143.607530:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019771776:0@lo:400:kworker.0 00000100:00100000:3.0:1788851143.607557:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851143.607588:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788851143.607596:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019770880:0@lo:400:kworker.0 00000100:00100000:3.0:1788851143.607620:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851143.607642:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019771392:0@lo:400:kworker.0 00000100:00100000:3.0:1788851143.607662:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851143.607702:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019770880 00000100:00100000:3.0:1788851143.607709:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019770880 00000100:00100000:3.0:1788851143.607749:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788851143.607755:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875746019770880:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788851143.607763:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788851143.607800:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875746019770880:12345-0@lo:400:kworker.0 Request processed in 43us (178us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788851143.607806:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:3.0:1788851143.607845:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788851143.607850:0:3647:0:(import.c:65:import_set_state_nolock()) ffff892ea4302800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788851143.607854:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788851143.607859:0:3647:0:(import.c:65:import_set_state_nolock()) ffff892ea4302800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851143.607863:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 234 00000100:00080000:3.0:1788851143.607871:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff892ea4302800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851143.607911:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c95500 x1875746019771904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851143.607933:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019770880:0@lo:400:kworker.0 00000100:00100000:3.0:1788851143.607982:0:10526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019771264 00000100:00100000:3.0:1788851143.607986:0:10526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019771264 00000100:00100000:3.0:1788851143.608069:0:10526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788851143.608076:0:10526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019771264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851143.608118:0:10526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019771264:12345-0@lo:400:kworker.0 Request processed in 43us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851143.608125:0:10526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:3.0:1788851143.608144:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788851143.608164:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5ad6680 x1875746019771264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851143.608175:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019771264:0@lo:400:kworker.0 00000100:00100000:2.0:1788851143.608404:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019771776 00000100:00100000:2.0:1788851143.608409:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019771776 00000100:00100000:2.0:1788851143.608444:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019771392 00000100:00100000:2.0:1788851143.608454:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019771392 00000100:00100000:2.0:1788851143.608479:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788851143.608487:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019771776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851143.608529:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019771776:12345-0@lo:400:kworker.0 Request processed in 44us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851143.608536:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788851143.608547:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788851143.608553:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019771392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851143.608579:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019771392:12345-0@lo:400:kworker.0 Request processed in 26us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851143.608585:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1788851143.608607:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851143.608609:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851143.608630:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019771392:0@lo:400:kworker.0 00000100:00100000:2.0:1788851143.608641:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019771776:0@lo:400:kworker.0 00000100:00100000:0.0:1788851143.608831:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019771904:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788851143.608861:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851143.608886:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019772032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788851143.608908:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851143.608939:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019772032 00000100:00100000:0.0:1788851143.608942:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019772032 00000100:00100000:0.0:1788851143.608970:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788851143.608976:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019772032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851143.609024:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788851143.609062:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019772032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851143.609078:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788851143.609114:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019772032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788851143.609130:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019771904 00000100:00100000:0.0:1788851143.609133:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019771904 00000100:00100000:0.0:1788851143.609156:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788851143.609161:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019771904:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788851143.609175:0:6539:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851143.610384:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019772160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851143.610441:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851143.611002:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019772160 00000100:00100000:3.0:1788851143.611040:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019772160 00000100:00100000:3.0:1788851143.611092:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788851143.611102:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019772160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788851143.611133:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788851143.611191:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019772160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851143.611198:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788851143.611306:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019772160:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788851143.640195:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892ea568a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851143.640206:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 234 00000100:00080000:1.0:1788851143.640224:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff892ea568a800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851143.640296:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad4000 x1875746019772288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851143.640339:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019771008:0@lo:400:kworker.0 00000100:00080000:1.0:1788851143.640378:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788851143.640399:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788851143.640403:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788851143.640406:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851143.640409:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 276 00000100:00080000:1.0:1788851143.640417:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892d87492800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851143.640431:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad6d80 x1875746019772416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851143.640443:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019771520:0@lo:400:kworker.0 00000100:00080000:1.0:1788851143.640458:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788851143.640462:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788851143.640465:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788851143.640468:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851143.640472:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 254 00000100:00080000:1.0:1788851143.640476:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff892d85c51800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851143.640492:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad4e00 x1875746019772544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851143.640502:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019771136:0@lo:400:kworker.0 00010000:00080000:1.0:1788851143.640518:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5ad5500 x1875746019771648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851143.640529:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019771648:0@lo:400:kworker.0 00000100:00100000:2.0:1788851143.645072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019772288:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788851143.645160:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851143.645225:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019772416:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788851143.645249:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851143.645274:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019772544:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788851143.645295:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851143.645362:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019772288 00000100:00100000:2.0:1788851143.645372:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019772288 00000100:00100000:2.0:1788851143.645420:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019772416 00000100:00100000:2.0:1788851143.645425:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019772416 00000100:00100000:2.0:1788851143.645440:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019772544 00000100:00100000:2.0:1788851143.645442:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019772544 00000100:00100000:2.0:1788851143.645456:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788851143.645464:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019772288:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788851143.645483:0:6536:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851143.645528:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019772288:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 63us (367us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851143.645536:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788851143.645554:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788851143.645558:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019772416:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788851143.645564:0:6536:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851143.645587:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019772416:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 27us (337us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851143.645593:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788851143.645603:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788851143.645606:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019772544:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788851143.645613:0:6536:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851143.645634:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019772544:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 26us (338us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851143.645639:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1788851143.645682:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea568a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851143.645687:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851143.645691:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019772288:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788851143.645699:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851143.645709:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851143.645712:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019772416:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788851143.645722:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851143.645725:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851143.645728:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019772544:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788851143.667235:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019771904:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 58061us (58361us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788851143.667251:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:3.0:1788851143.670328:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4302800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851143.670342:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788851143.670348:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019771904:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1788851143.860836:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851144.884412:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851145.908433:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851146.932815:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851147.957549:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851148.724856:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019772672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851148.724947:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851148.725101:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019772672 00000100:00100000:3.0:1788851148.725120:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019772672 00000100:00100000:3.0:1788851148.725223:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788851148.725233:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019772672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788851148.725262:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788851148.725312:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019772672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851148.725319:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1788851148.726190:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851148.726195:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788851148.726199:0:8:0:(import.c:65:import_set_state_nolock()) ffff892ea4302800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851148.726205:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 477 00000100:00080000:0.0:1788851148.726209:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788851148.726217:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff892ea4302800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851148.726238:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c36d80 x1875746019772928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851148.726254:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851148.726257:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788851148.726259:0:8:0:(import.c:65:import_set_state_nolock()) ffff892ea568a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851148.726262:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 477 00000100:00080000:0.0:1788851148.726274:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788851148.726280:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff892ea568a800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851148.726294:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c36680 x1875746019773056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851148.726303:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851148.726305:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788851148.726307:0:8:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851148.726310:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 477 00000100:00080000:0.0:1788851148.726313:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788851148.726316:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff892d85c51800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851148.726326:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c36300 x1875746019773184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851148.726340:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851148.726343:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788851148.726345:0:8:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851148.726347:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 477 00000100:00080000:0.0:1788851148.726349:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788851148.726352:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892d87492800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851148.726361:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c35500 x1875746019773440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788851148.726395:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019773312:0@lo:400:kworker.0 00000100:00100000:0.0:1788851148.726451:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851148.726476:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851148.726482:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019772800:0@lo:400:kworker.0 00000100:00100000:0.0:1788851148.726518:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851148.726553:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019772800 00000100:00100000:0.0:1788851148.726558:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019772800 00000100:00100000:0.0:1788851148.726594:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788851148.726602:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:3648:x1875746019772800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851148.726641:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebfff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c5226fe-29cd-49fb-9546-e50c12b232cb+19:3648:x1875746019772800:12345-0@lo:400:kworker.0 Request processed in 39us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851148.726647:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788851148.726689:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019772800:0@lo:400:kworker.0 00000100:00100000:3.0:1788851148.727118:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019772928:0@lo:38:kworker.0 00000100:00100000:3.0:1788851148.727151:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851148.727171:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019773056:0@lo:38:kworker.0 00000100:00100000:3.0:1788851148.727203:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851148.727220:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019773184:0@lo:38:kworker.0 00000100:00100000:3.0:1788851148.727251:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851148.727266:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019773440:0@lo:38:kworker.0 00000100:00100000:3.0:1788851148.727284:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788851148.727298:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851148.727311:0:13555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019772928 00000100:00100000:3.0:1788851148.727316:0:13555:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019772928 00000100:00100000:3.0:1788851148.727339:0:13555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788851148.727344:0:13555:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875746019772928:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788851148.727358:0:13555:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788851148.727418:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019773696:0@lo:400:kworker.0 00000100:00100000:1.0:1788851148.727448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851148.727483:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019772672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851148.727496:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851148.727501:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019773568:0@lo:400:kworker.0 00000100:00100000:1.0:1788851148.727522:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851148.727920:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019773312 00000100:00100000:2.0:1788851148.727925:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019773312 00000100:00100000:2.0:1788851148.727959:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019773056 00000100:00100000:2.0:1788851148.727963:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019773056 00000100:00100000:2.0:1788851148.727971:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019773184 00000100:00100000:2.0:1788851148.727974:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019773184 00000100:00100000:2.0:1788851148.727981:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019773440 00000100:00100000:2.0:1788851148.727984:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019773440 00000100:00100000:2.0:1788851148.727990:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019773568 00000100:00100000:2.0:1788851148.727993:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019773568 00000100:00100000:2.0:1788851148.728009:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788851148.728033:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019773312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851148.728083:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019773312:12345-0@lo:400:kworker.0 Request processed in 51us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851148.728089:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788851148.728104:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788851148.728130:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019773568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851148.728165:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019773568:12345-0@lo:400:kworker.0 Request processed in 55us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851148.728171:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788851148.728190:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788851148.728195:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019773056:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788851148.728204:0:6535:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851148.728237:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019773056:12345-0@lo:38:kworker.0 Request processed in 41us (1044us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851148.728243:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788851148.728254:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788851148.728258:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019773184:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788851148.728265:0:6535:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851148.728286:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019773184:12345-0@lo:38:kworker.0 Request processed in 26us (1033us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851148.728291:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788851148.728302:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788851148.728305:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019773440:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788851148.728312:0:6535:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851148.728334:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019773440:12345-0@lo:38:kworker.0 Request processed in 27us (1049us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851148.728340:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1788851148.728373:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851148.728394:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea568a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851148.728398:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851148.728402:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019773056:0@lo:38:kworker.0 00000100:00080000:2.0:1788851148.728411:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851148.728414:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851148.728417:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019773184:0@lo:38:kworker.0 00000100:00080000:2.0:1788851148.728424:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851148.728433:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851148.728436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019773440:0@lo:38:kworker.0 00000100:00100000:2.0:1788851148.728462:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019773696 00000100:00100000:2.0:1788851148.728466:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019773696 00000100:00100000:2.0:1788851148.728497:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788851148.728503:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019773696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851148.728534:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019773696:12345-0@lo:400:kworker.0 Request processed in 31us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851148.728539:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788851148.728552:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788851148.728575:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c36a00 x1875746019773312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851148.728586:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019773312:0@lo:400:kworker.0 00010000:00080000:2.0:1788851148.728621:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c34000 x1875746019773568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851148.728630:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019773568:0@lo:400:kworker.0 00000100:00100000:2.0:1788851148.728640:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019773696:0@lo:400:kworker.0 00000100:00100000:0.0:1788851148.737037:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851148.737067:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019773824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851148.737152:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851148.739086:0:12687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019773824 00000100:00100000:1.0:1788851148.739101:0:12687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019773824 00000100:00100000:1.0:1788851148.739179:0:12687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788851148.739190:0:12687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019773824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851148.739223:0:12687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000001:00100000:2.0:1788851148.739554:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788851148.739560:0:6513:0:(genops.c:885:class_export_put()) final put ffff892ead295800/lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788851148.739862:0:12687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019773824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 673us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851148.739871:0:12687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788851148.740118:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019773824:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788851148.745971:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788851148.745988:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788851148.745994:0:7465:0:(genops.c:885:class_export_put()) final put ffff892eab221800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851148.746038:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ead295800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788851148.746159:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eab221800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788851148.746192:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea556e800 for lustre-MDT0000 00000020:00000080:0.0:1788851148.746201:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ead296000 for lustre-MDT0001 00000100:00100000:3.0:1788851148.748780:0:13555:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875746019772928:12345-0@lo:38:kworker.0 Request processed in 21427us (21621us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788851148.748794:0:13555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:2.0:1788851148.748960:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4302800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851148.748965:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851148.748970:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019772928:0@lo:38:kworker.0 00000001:00100000:0.0:1788851148.750797:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851148.750806:0:9528:0:(genops.c:885:class_export_put()) final put ffff892d879a0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788851148.750938:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d879a0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788851148.751138:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d879a3000 for lustre-OST0001 00000001:00100000:3.0:1788851148.751864:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788851148.751870:0:8443:0:(genops.c:885:class_export_put()) final put ffff892ea4304000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788851148.752120:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea4304000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788851148.761503:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea576b800 for lustre-OST0000 00010000:00010000:2.0:1788851148.980306:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788851149.365091:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892ea5b64960 - data ffff892d860da510/ffff892ea7c48c00 00000020:01000000:3.0:1788851149.366534:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892ea19be840 - data ffff892eb354d510/ffff892eb6cb1400 00000001:00000004:3.0:1788851149.379637:0:15222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:3.0:1788851149.443782:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788851149.443792:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788851149.443807:0:15222:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff892e87c30700 x1875746019770496/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788851153 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851149.444405:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788851149.450623:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788851149.450632:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788851149.450657:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851149.450660:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788851149.451056:0:8617:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788851149.451063:0:8617:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788851149.451073:0:8617:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788851149.451795:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788851149.451801:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788851149.451984:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851149.451986:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788851149.455066:0:9884:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788851149.455076:0:9884:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788851149.455106:0:9884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788851149.458778:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205489 00000020:00000080:0.0:1788851149.458791:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e83e2d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851149.459367:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e2d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788851149.467450:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20549e 00000020:00000080:0.0:1788851149.467464:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e83e29000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788851149.467480:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788851149.467485:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851149.467493:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788851149.467498:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff892e83e3cd40) has no exports 00000004:01000000:0.0:1788851149.467670:0:15222:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788851149.467678:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2058d4 00000020:00000080:0.0:1788851149.467683:0:15222:0:(genops.c:885:class_export_put()) final put ffff892d876bb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788851149.467688:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788851149.467691:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851149.467701:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788851149.467703:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff892d874a4d40) has no exports 00000020:00000080:0.0:1788851149.467711:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2058cd 00000020:00000080:0.0:1788851149.467715:0:15222:0:(genops.c:885:class_export_put()) final put ffff892d876b8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851149.469263:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e29000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788851149.469278:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d876bb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788851149.469283:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d876b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788851149.472073:0:15222:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788851149.472083:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788851149.472087:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788851149.472116:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851149.472118:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851149.472174:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851149.472188:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788851149.472198:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205792 00000020:00000080:1.0:1788851149.472207:0:15222:0:(genops.c:885:class_export_put()) final put ffff892ea7c1d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788851149.472213:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788851149.472217:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851149.472223:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788851149.472227:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff892d85f24d40) has no exports 00000020:00000080:1.0:1788851149.472235:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20578b 00000020:00000080:1.0:1788851149.472238:0:15222:0:(genops.c:885:class_export_put()) final put ffff892ea5b9f800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788851149.472623:0:15222:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788851149.472627:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788851149.472630:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788851149.472634:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851149.472635:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851149.472669:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851149.472675:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788851149.472690:0:15222:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788851149.472696:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205642 00000020:00000080:1.0:1788851149.472701:0:15222:0:(genops.c:885:class_export_put()) final put ffff892eb6c25800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788851149.472705:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788851149.472709:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851149.472713:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788851149.472715:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff892ead6db380) has no exports 00000020:00000080:1.0:1788851149.472719:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20563b 00000020:00000080:1.0:1788851149.472721:0:15222:0:(genops.c:885:class_export_put()) final put ffff892ead290800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788851149.472934:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d85c50000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788851149.472942:0:8:0:(genops.c:885:class_export_put()) final put ffff892d876ba800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851149.472945:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d876ba800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788851149.472952:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851149.473045:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea7c1d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788851149.473050:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5b9f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788851149.473054:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea5b98800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788851149.473059:0:8:0:(genops.c:885:class_export_put()) final put ffff892d85c52000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851149.473061:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c52000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788851149.473064:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851149.473089:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6c25800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788851149.473100:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ead290800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788851149.474333:0:15222:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788851149.474340:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788851149.474343:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788851149.474349:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788851149.474393:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851149.474403:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851149.474427:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851149.474430:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851149.474434:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e83e29800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851149.474437:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e29800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788851149.474443:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851149.474519:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2054a5 00000020:00000080:0.0:1788851149.474526:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e83e2e800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788851149.474530:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788851149.474534:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851149.474537:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788851149.474540:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff892e83e399c0) has no exports 00000020:00000080:0.0:1788851149.474555:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851149.474558:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788851149.474562:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2054ac 00000020:00000080:0.0:1788851149.474565:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e83e2f000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788851149.474574:0:15222:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892e91596800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788851149.474577:0:15222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892e91596800 3 00000020:01000004:0.0:1788851149.474580:0:15222:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892e91596800 from lustre-MDT0000 00000020:00000080:0.0:1788851149.474596:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851149.474600:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788851149.474602:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e83e28800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788851149.474604:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e28800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788851149.474611:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788851149.474642:0:15222:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788851149.474655:0:15222:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788851149.474658:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788851149.474661:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851149.474664:0:15222:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788851149.474671:0:15222:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff892e8a52e000 5c5226fe-29cd-49fb-9546-e50c12b232cb 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788851149.474688:0:15222:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff892ec1ca0000) has exports, disconnecting them 00000020:00080000:0.0:1788851149.474693:0:15222:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff892e8a52e000), last request at 1788850882 00000020:00000080:0.0:1788851149.474711:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20544a 00000020:00010000:0.0:1788851149.474715:0:15222:0:(genops.c:1920:obd_stale_export_put()) Put export ffff892e8a52e000: total 2 00000100:00080000:0.0:1788851149.474719:0:15222:0:(import.c:65:import_set_state_nolock()) ffff892e8a52b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788851149.474734:0:15222:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892e8a52e000): rc 0 00000020:00080000:0.0:1788851149.474739:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff892ec1ca0000) has no exports 00000020:00010000:0.0:1788851149.474749:0:6522:0:(genops.c:1906:obd_stale_export_get()) Get export ffff892e8a52e000: total 2 00010000:00010000:0.0:1788851149.474773:0:6522:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff892e8a52e000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788851149.474805:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2155200/0x3e0030720b205554 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b20554d expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474840:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eeba200/0x3e0030720b205991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b20598a expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474851:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80030e00/0x3e0030720b205546 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b20553f expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474863:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031e00/0x3e0030720b205beb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205be4 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474873:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e7800/0x3e0030720b2059bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b2059b4 expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474894:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433da00/0x3e0030720b20594b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205944 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474918:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff95800/0x3e0030720b205bf9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205bf2 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474929:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff95400/0x3e0030720b205959 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205952 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474939:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433dc00/0x3e0030720b205c07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205c00 expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474950:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433cc00/0x3e0030720b20586b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205864 expref: 5 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474963:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6400/0x3e0030720b205967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b205960 expref: 4 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474975:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebbc00/0x3e0030720b205983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b20597c expref: 3 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474986:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433c800/0x3e0030720b205975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b20596e expref: 2 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851149.474996:0:6522:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff892e8a52e000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788851149.475010:0:6522:0:(genops.c:885:class_export_put()) final put ffff892e8a52e000/5c5226fe-29cd-49fb-9546-e50c12b232cb 00010000:00010000:0.0:1788851149.475044:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851149.475046:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851149.475048:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851149.475120:0:6528:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff892e8a514c00:6528] 1 exiting: rc = 0 00000020:00000080:3.0:1788851149.475363:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ead296800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788851149.475370:0:8:0:(genops.c:885:class_export_put()) final put ffff892ea5689000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788851149.475372:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5689000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788851149.475380:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788851149.475433:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e2e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788851149.475437:0:8:0:(genops.c:885:class_export_put()) final put ffff892e83e2e000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788851149.475439:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e2e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788851149.475442:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788851149.475464:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e2f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788851149.475468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e8a52e000/5c5226fe-29cd-49fb-9546-e50c12b232cb for MGS 00000020:00000080:3.0:1788851149.475490:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892e8a52b000 for MGS 00000100:00100000:0.0:1788851149.475621:0:6529:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff892e90928800:6529] 2 exiting: rc = 0 00000100:00100000:0.0:1788851149.476377:0:6526:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff892ead73c200:6526] 0 exiting: rc = 1 00000100:00100000:3.0:1788851149.476514:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476524:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476531:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476538:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476554:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476560:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476566:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476572:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476578:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476582:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476588:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476594:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476602:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476609:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476615:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476621:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476627:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476634:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476640:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476647:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476654:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476660:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476666:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476672:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476689:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476698:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476705:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476712:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476718:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476724:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476729:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476734:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476740:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476745:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476751:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476756:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476761:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476768:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476775:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476788:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476793:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476799:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476805:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476822:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476829:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476835:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476842:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476848:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476854:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476860:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476866:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476872:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476888:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476894:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476900:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476906:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476912:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476917:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476923:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476930:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476936:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476941:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476947:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851149.476955:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788851149.480381:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892ea7c4d300 - data ffff892eb3700000/ffff892d879d0800 00000020:01000000:3.0:1788851149.480519:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892e90da07e0 - data ffff892eb34fa288/ffff892e8a526400 00000020:00000080:3.0:1788851149.482251:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20542e 00000020:00000080:3.0:1788851149.482264:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e88cdd800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788851149.482283:0:15222:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892e91596800 from MGS, refs=2 00000020:01000004:3.0:1788851149.482287:0:15222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892e91596800 2 00000020:01000004:3.0:1788851149.482290:0:15222:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892e91596800 from MGS 00000020:00000080:3.0:1788851149.482311:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851149.482317:0:15222:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788851149.482331:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e88cdb000/MGS 00000020:00000080:3.0:1788851149.482333:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88cdb000/MGS for MGS 00000020:01000000:3.0:1788851149.482340:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788851149.482400:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788851149.482405:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851149.482410:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788851149.482416:0:15222:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff892eb6c23000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788851149.482421:0:15222:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff892ebbbcb380) has exports, disconnecting them 00000020:00080000:3.0:1788851149.482426:0:15222:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff892eb6c23000), last request at 1788850883 00000020:00000080:3.0:1788851149.482431:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2054f9 00000020:00080000:3.0:1788851149.482441:0:15222:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892eb6c23000): rc 0 00000020:00000080:3.0:1788851149.482445:0:15222:0:(genops.c:885:class_export_put()) final put ffff892eb6c23000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788851149.485819:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88cdd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788851149.485847:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6c23000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788851149.490475:0:15222:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788851149.490484:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851149.490488:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788851149.490494:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788851149.490526:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892eb6c20000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788851149.490698:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851149.490708:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788851149.490714:0:15222:0:(genops.c:885:class_export_put()) final put ffff892eab220000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788851149.490718:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff892eab220000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788851149.490727:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788851149.490800:0:15222:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892e91596800 1 00000020:00000080:0.0:1788851149.490806:0:15222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205420 00000020:00000080:0.0:1788851149.490824:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e88cde000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788851149.490833:0:15222:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788851149.490840:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88cde000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788851149.490850:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851149.490854:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788851149.490858:0:15222:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff892ec1ca4d40) has no exports 00000020:00000080:1.0:1788851149.716735:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851149.716749:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788851149.716755:0:15222:0:(genops.c:885:class_export_put()) final put ffff892e91590800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851149.716759:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff892e91590800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788851149.716775:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788851149.716977:0:15222:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff892e91593000 00000020:02000400:1.0:1788851149.717244:0:15222:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788851150.007622:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851151.028654:0:13817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851151.029102:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851152.052966:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851153.079185:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851153.844227:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019773952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851153.844300:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851153.844376:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019773952 00000100:00100000:1.0:1788851153.844384:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019773952 00000100:00100000:1.0:1788851153.844441:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788851153.844451:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019773952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851153.844482:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788851153.844527:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019773952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851153.844534:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1788851153.844554:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851153.844590:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019773952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851153.849040:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019774080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851153.849112:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851153.849177:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019774080 00000100:00100000:1.0:1788851153.849185:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019774080 00000100:00100000:1.0:1788851153.849237:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788851153.849247:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019774080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851153.849278:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788851153.849323:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019774080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851153.849330:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1788851153.849352:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851153.849387:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019774080:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788851153.858598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788851153.858605:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788851153.858609:0:37:0:(import.c:65:import_set_state_nolock()) ffff892ea4302800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851153.858616:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788851153.858623:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788851153.858636:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff892ea4302800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851153.858658:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c34380 x1875746019774336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851153.858675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788851153.858678:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788851153.858680:0:37:0:(import.c:65:import_set_state_nolock()) ffff892ea568a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851153.858684:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788851153.858687:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788851153.858691:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff892ea568a800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851153.858720:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c34e00 x1875746019774464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851153.858731:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788851153.858734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788851153.858736:0:37:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851153.858739:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788851153.858742:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788851153.858747:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff892d85c51800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851153.858760:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c35c00 x1875746019774592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851153.858788:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788851153.858792:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788851153.858805:0:37:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851153.858809:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788851153.858812:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788851153.858817:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892d87492800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851153.858831:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7d65880 x1875746019774848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851153.858867:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019774208:0@lo:400:kworker.0 00000400:00000100:3.0:1788851153.858919:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875746019774208 offset 0 length 224: 4 00000100:00100000:3.0:1788851153.859060:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019774720:0@lo:400:kworker.0 00000100:00100000:3.0:1788851153.859098:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851153.859120:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851153.859126:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019774976:0@lo:400:kworker.0 00000100:00100000:3.0:1788851153.859163:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851153.859264:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019774336:0@lo:38:kworker.0 00000100:00100000:2.0:1788851153.859298:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851153.859320:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019774464:0@lo:38:kworker.0 00000100:00100000:2.0:1788851153.859342:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851153.859359:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019774592:0@lo:38:kworker.0 00000100:00100000:2.0:1788851153.859379:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851153.859396:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019774848:0@lo:38:kworker.0 00000100:00100000:2.0:1788851153.859416:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851153.859449:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019774720 00000100:00100000:2.0:1788851153.859456:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019774720 00000100:00100000:2.0:1788851153.859505:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019774976 00000100:00100000:2.0:1788851153.859508:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019774976 00000100:00100000:2.0:1788851153.859521:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019774464 00000100:00100000:2.0:1788851153.859523:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019774464 00000100:00100000:2.0:1788851153.859530:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019774592 00000100:00100000:2.0:1788851153.859533:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019774592 00000100:00100000:2.0:1788851153.859539:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019774848 00000100:00100000:2.0:1788851153.859541:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019774848 00000100:00100000:2.0:1788851153.859552:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788851153.859560:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019774720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851153.859613:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019774720:12345-0@lo:400:kworker.0 Request processed in 53us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851153.859620:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788851153.859635:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788851153.859641:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019774976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851153.859667:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019774976:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851153.859683:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788851153.859696:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788851153.859699:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019774464:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788851153.859718:0:6535:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851153.859752:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019774464:12345-0@lo:38:kworker.0 Request processed in 51us (410us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851153.859758:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788851153.859770:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788851153.859789:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019774592:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788851153.859809:0:6535:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851153.859833:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019774592:12345-0@lo:38:kworker.0 Request processed in 43us (453us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851153.859839:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788851153.859852:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788851153.859856:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019774848:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788851153.859865:0:6535:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851153.859889:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019774848:12345-0@lo:38:kworker.0 Request processed in 32us (472us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851153.859895:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788851153.859919:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019774336 00000100:00100000:2.0:1788851153.859923:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019774336 00000100:00100000:2.0:1788851153.859941:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788851153.859946:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875746019774336:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788851153.859956:0:6540:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851153.859989:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875746019774336:12345-0@lo:38:kworker.0 Request processed in 41us (690us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851153.859995:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:2.0:1788851153.860047:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788851153.860076:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff892ea7d67b80 x1875746019774976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851153.860091:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019774976:0@lo:400:kworker.0 00010000:00080000:2.0:1788851153.860104:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff892e87c30700 x1875746019774720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851153.860112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019774720:0@lo:400:kworker.0 00000100:00080000:2.0:1788851153.860145:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4302800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851153.860150:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851153.860153:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019774336:0@lo:38:kworker.0 00000100:00080000:2.0:1788851153.860161:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea568a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851153.860165:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851153.860168:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019774464:0@lo:38:kworker.0 00000100:00080000:2.0:1788851153.860176:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851153.860179:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851153.860182:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019774592:0@lo:38:kworker.0 00000100:00080000:2.0:1788851153.860189:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851153.860192:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851153.860194:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019774848:0@lo:38:kworker.0 00010000:00010000:3.0:1788851154.101829:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851155.126208:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788851155.223371:0:15423:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788851155.249185:0:15423:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788851155.249244:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.249259:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.249267:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.249275:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.249294:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788851155.249299:0:15423:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788851155.249327:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851155.249332:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788851155.249338:0:15423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788851155.249344:0:15423:0:(import.c:65:import_set_state_nolock()) ffff892ea568a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788851155.249349:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851155.249351:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788851155.249354:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788851155.250319:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250333:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250340:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250360:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250377:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788851155.250383:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250389:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250394:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250398:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250404:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788851155.250409:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250415:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250420:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250424:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250439:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788851155.250445:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250450:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250455:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250461:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851155.250467:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1788851155.250470:0:15423:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788851155.250495:0:15423:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788851155.250500:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788851155.250504:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851155.250510:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788851155.250517:0:15423:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff892ea5b9f000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851155.250522:0:15423:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff892eb6c25000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851155.250526:0:15423:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff892eb6f44d40) has exports, disconnecting them 00000020:00080000:1.0:1788851155.250531:0:15423:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff892ea5b9f000), last request at 1788851153 00000020:00000080:1.0:1788851155.250537:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20582c 00000100:00080000:1.0:1788851155.250556:0:15423:0:(import.c:65:import_set_state_nolock()) ffff892ea5b9d000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788851155.250603:0:15423:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892ea5b9f000): rc 0 00000020:00000080:1.0:1788851155.250605:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea5b9f000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788851155.250618:0:15423:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff892eb6c25000), last request at 1788851153 00000020:00000080:1.0:1788851155.250628:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205706 00000100:00080000:1.0:1788851155.250634:0:15423:0:(import.c:65:import_set_state_nolock()) ffff892eb6c27800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788851155.250641:0:15423:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892eb6c25000): rc 0 00000020:00000080:1.0:1788851155.250643:0:15423:0:(genops.c:885:class_export_put()) final put ffff892eb6c25000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788851155.250650:0:15423:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa990418efae0 00000100:00080000:1.0:1788851155.250667:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851155.250670:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1788851155.251583:0:15423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788851155.251589:0:15423:0:(import.c:65:import_set_state_nolock()) ffff892ea4302800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788851155.251723:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788851155.251726:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788851155.251738:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788851155.251810:0:15423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788851155.251834:0:15423:0:(import.c:65:import_set_state_nolock()) ffff892ead290000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788851155.251857:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788851155.251859:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788851155.251867:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1788851155.252295:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788851155.252304:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252315:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851155.252319:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252330:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851155.252338:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851155.252343:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788851155.252346:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788851155.252349:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788851155.252377:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252384:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851155.252401:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252409:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff95200/0x3e0030720b20597c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205983 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252421:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788851155.252437:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252457:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7400 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851155.252460:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252468:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851155.252475:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851155.252480:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788851155.252482:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788851155.252484:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788851155.252498:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252503:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851155.252509:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252516:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892d876e7400/0x3e0030720b20598a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205991 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252524:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788851155.252529:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252535:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851155.252538:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252550:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851155.252556:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851155.252561:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788851155.252563:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788851155.252564:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788851155.252574:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252579:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851155.252594:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252608:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ea000/0x3e0030720b205864 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b20586b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252622:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851155.252625:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252631:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851155.252634:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252641:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851155.252658:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851155.252664:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788851155.252666:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788851155.252668:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788851155.252681:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252687:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851155.252694:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252701:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b205c00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205c07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252710:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851155.252722:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252728:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eb800 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851155.252731:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252737:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851155.252743:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851155.252758:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788851155.252760:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788851155.252761:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788851155.252784:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252789:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851155.252794:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252799:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827eb800/0x3e0030720b20554d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b205554 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851155.252812:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851155.252813:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851155.252815:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788851155.252827:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5b9f000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788851155.252876:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6c25000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788851155.252899:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea5b9d000 for lustre-MDT0001 00000020:00000080:3.0:1788851155.252903:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892eb6c27800 for lustre-MDT0001 00000100:00100000:3.0:1788851155.252922:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019775232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851155.253222:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851155.253276:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019775744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851155.253298:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851155.253324:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851155.253329:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019775360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851155.253351:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851155.253392:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019775616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851155.253414:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851155.253441:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851155.253447:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019775488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851155.253466:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851155.253490:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019775232 00000100:00100000:3.0:1788851155.253497:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019775232 00000100:00100000:3.0:1788851155.253522:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019775744 00000100:00100000:3.0:1788851155.253525:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019775744 00000100:00100000:3.0:1788851155.253531:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019775360 00000100:00100000:3.0:1788851155.253533:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019775360 00000100:00100000:3.0:1788851155.253539:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019775616 00000100:00100000:3.0:1788851155.253541:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019775616 00000100:00100000:3.0:1788851155.253549:0:7476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019775488 00000100:00100000:3.0:1788851155.253551:0:7476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019775488 00000100:00100000:3.0:1788851155.253561:0:7476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788851155.253568:0:7476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875746019775232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788851155.253574:0:7476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851155 with bad export cookie 4467624096722605130 00010000:00010000:0.0:1788851155.253897:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851155.254894:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019775104:0@lo:9:umount.0 00000100:00100000:2.0:1788851155.254957:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851155.255053:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788851155.255060:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875746019775744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788851155.255066:0:6519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851155 with bad export cookie 4467624096722605130 00000100:00100000:2.0:1788851155.255115:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875746019775744:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1815us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851155.255122:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788851155.255144:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788851155.255148:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ead2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875746019775360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788851155.255152:0:6519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851155 with bad export cookie 4467624096722605130 00000100:00100000:2.0:1788851155.255176:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ead2b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875746019775360:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (1824us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851155.255182:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788851155.255194:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788851155.255198:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875746019775616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788851155.255202:0:6519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851155 with bad export cookie 4467624096722605130 00000100:00100000:2.0:1788851155.255228:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875746019775616:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (1813us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851155.255233:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788851155.255243:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788851155.255247:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875746019775488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788851155.255251:0:6519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851155 with bad export cookie 4467624096722605130 00000100:00100000:2.0:1788851155.255273:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875746019775488:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (1805us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851155.255278:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788851155.255324:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788851155.255336:0:3649:0:(import.c:65:import_set_state_nolock()) ffff892e8a52d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788851155.255339:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788851155.255537:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019775104 00000100:00100000:0.0:1788851155.255543:0:8625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019775104 00000100:00100000:0.0:1788851155.255590:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788851155.256068:0:8625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875746019775104:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788851155.256099:0:8625:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205761 00000100:00080000:0.0:1788851155.256117:0:8625:0:(import.c:65:import_set_state_nolock()) ffff892d85c54000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851155.256160:0:8625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788851155.256312:0:8625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3646:x1875746019775104:12345-0@lo:9:umount.0 Request processed in 715us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851155.256320:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788851155.256340:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788851155.256351:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851155.256375:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ead290000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788851155.256387:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788851155.256390:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851155.256393:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019775104:0@lo:9:umount.0 00000100:00080000:1.0:1788851155.262180:0:15423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788851155.262220:0:15423:0:(import.c:65:import_set_state_nolock()) ffff892ea5933800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788851155.262270:0:15423:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff892eb6f44d40) has no exports 00000100:00100000:0.0:1788851155.262337:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019775872:0@lo:9:umount.0 00000100:00100000:0.0:1788851155.262407:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788851155.263332:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788851155.263404:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019775872 00000100:00100000:1.0:1788851155.263413:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019775872 00000100:00100000:1.0:1788851155.263493:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788851155.263503:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875746019775872:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788851155.263532:0:8449:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205895 00000100:00080000:1.0:1788851155.263542:0:8449:0:(import.c:65:import_set_state_nolock()) ffff892ea5b99800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788851155.263586:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788851155.263776:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3646:x1875746019775872:12345-0@lo:9:umount.0 Request processed in 264us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851155.263797:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788851155.268142:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788851155.271161:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788851155.273171:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5933800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788851155.273199:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788851155.273202:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851155.273208:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019775872:0@lo:9:umount.0 00000100:00080000:2.0:1788851155.289538:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.127@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788851155.289544:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788851155.289555:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea7c35f80 x1875746019774208/t0(0) o400->MGC192.168.204.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788851169 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851155.289578:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea7d65180 x1875746019775232/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851171 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851155.289587:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea7d3e300 x1875746019775744/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851171 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851155.289667:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea7d65880 x1875746019775360/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851171 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851155.289677:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea7d3f800 x1875746019775616/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851171 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851155.289686:0:3649:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea7d67b80 x1875746019775488/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851171 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788851155.289886:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff892e8a52d800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788851155.289915:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019775616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851155.289946:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c5226fe-29cd-49fb-9546-e50c12b232cb:3648:1875746019775488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851155.292158:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c5226fe-29cd-49fb-9546-e50c12b232cb:3650:1875746019774208:0@lo:400:kworker.0 00000100:00100000:3.0:1788851155.293256:0:7476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875746019775232:12345-0@lo:103:ldlm_bl.0 Request processed in 39681us (40029us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788851155.293270:0:7476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 10000000:01000000:2.0:1788851155.295272:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788851155.295282:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788851155.295284:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788851155.295289:0:3649:0:(import.c:65:import_set_state_nolock()) ffff892e8a52d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851155.295298:0:3649:0:(import.c:545:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 216 00000100:00080000:2.0:1788851155.295314:0:3649:0:(import.c:666:import_select_connection()) MGC192.168.204.127@tcp: import ffff892e8a52d800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851155.295375:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c35f80 x1875746019776000/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851155.295442:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c5226fe-29cd-49fb-9546-e50c12b232cb:3646:1875746019776000:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788851155.295491:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875746019776000 offset 0 length 520: 4 00000100:00100000:2.0:1788851155.296536:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019775232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851155.296682:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019775744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851155.296793:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c5226fe-29cd-49fb-9546-e50c12b232cb:3649:1875746019775360:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788851155.301268:0:15423:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff892eb6f44d40) has no exports 00000020:01000000:3.0:1788851155.355421:0:15423:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892ea7c4d180 - data ffff892eb3700288/ffff892d879d1000 00000020:01000000:3.0:1788851155.355606:0:15423:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892e856a6cc0 - data ffff892eb358f360/ffff892ea55dc000 00000001:00000004:3.0:1788851155.370365:0:15423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788851155.425999:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788851155.426008:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788851155.426045:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788851155.429449:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788851155.429458:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788851155.429488:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788851155.429491:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788851155.430041:0:8610:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788851155.430047:0:8610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788851155.430057:0:8610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788851155.430944:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788851155.430950:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788851155.431313:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788851155.431316:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788851155.431709:0:9880:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788851155.431714:0:9880:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788851155.431723:0:9880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788851155.432840:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205570 00000020:00000080:3.0:1788851155.432851:0:15423:0:(genops.c:885:class_export_put()) final put ffff892e98331000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788851155.433316:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e98331000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788851155.436294:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205585 00000020:00000080:3.0:1788851155.436308:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea42ea800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788851155.436433:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788851155.436440:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851155.436449:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788851155.436453:0:15423:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff892eb6f43380) has no exports 00000004:01000000:3.0:1788851155.436636:0:15423:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788851155.436645:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20588e 00000020:00000080:3.0:1788851155.436650:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea5971800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788851155.436965:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea42ea800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788851155.437009:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788851155.437039:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851155.437047:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788851155.437050:0:15423:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff892d87ac4d40) has no exports 00000020:00000080:3.0:1788851155.437056:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205887 00000020:00000080:3.0:1788851155.437061:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea5931800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788851155.437398:0:15423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788851155.437403:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788851155.437407:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788851155.437413:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788851155.437415:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851155.437588:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5971800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788851155.437668:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5931800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788851155.437897:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851155.437908:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788851155.437914:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20574c 00000020:00000080:0.0:1788851155.437930:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea5930800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788851155.438298:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea5933800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788851155.438306:0:8:0:(genops.c:885:class_export_put()) final put ffff892d879a5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788851155.438308:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d879a5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788851155.438313:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788851155.438546:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788851155.438552:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851155.438558:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788851155.438562:0:15423:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff892ebbbccd40) has no exports 00000020:00000080:0.0:1788851155.438568:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205745 00000020:00000080:0.0:1788851155.438572:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea5976000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788851155.439064:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5930800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:0.0:1788851155.439525:0:15423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788851155.439530:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788851155.439534:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1788851155.439540:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851155.439542:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851155.440158:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5976000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788851155.440273:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851155.440283:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788851155.440299:0:15423:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788851155.440306:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2055a8 00000020:00000080:0.0:1788851155.440313:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea4358000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788851155.440688:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ead290000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788851155.440759:0:8:0:(genops.c:885:class_export_put()) final put ffff892ea5975800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788851155.440772:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5975800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788851155.440777:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788851155.440971:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788851155.440977:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851155.440983:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788851155.440987:0:15423:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff892e83e3b380) has no exports 00000020:00000080:0.0:1788851155.440992:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2055a1 00000020:00000080:0.0:1788851155.440996:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea4305000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788851155.447563:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea4358000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788851155.447580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea4305000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788851155.450283:0:15423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788851155.450292:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851155.450297:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788851155.450305:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851155.450361:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851155.450373:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788851155.450398:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851155.450401:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788851155.450407:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea4305800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788851155.450412:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea4305800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788851155.450420:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788851155.450587:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20558c 00000020:00000080:1.0:1788851155.450605:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea42ed000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788851155.450610:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788851155.450614:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851155.450618:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788851155.450622:0:15423:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff892eb6f40000) has no exports 00000020:00000080:1.0:1788851155.450638:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851155.450641:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788851155.450644:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205593 00000020:00000080:1.0:1788851155.450647:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea42eb800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788851155.450653:0:15423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ebbbf6000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788851155.450656:0:15423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ebbbf6000 2 00000020:01000004:1.0:1788851155.450658:0:15423:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892ebbbf6000 from lustre-MDT0001 00000020:00000080:1.0:1788851155.450675:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851155.450677:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788851155.450679:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea4302000/lustre-MDT0001_UUID 00000020:00000080:1.0:1788851155.450681:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea4302000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788851155.450687:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:3.0:1788851155.450840:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea4302800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788851155.450849:0:8:0:(genops.c:885:class_export_put()) final put ffff892eb6cf0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788851155.450851:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6cf0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788851155.450873:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788851155.450973:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea42ed000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788851155.450977:0:8:0:(genops.c:885:class_export_put()) final put ffff892e88542000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788851155.450979:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88542000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788851155.450982:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788851155.451168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea42eb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:1.0:1788851155.451366:0:15423:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788851155.451370:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788851155.451374:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851155.451378:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788851155.451385:0:15423:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff892ea5688800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851155.451390:0:15423:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff892ead6d99c0) has exports, disconnecting them 00000020:00080000:1.0:1788851155.451395:0:15423:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff892ea5688800), last request at 1788850900 00000020:00000080:1.0:1788851155.451399:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2055e7 00000020:00080000:1.0:1788851155.451412:0:15423:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892ea5688800): rc 0 00000020:00000080:1.0:1788851155.451415:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ea5688800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788851155.452374:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5688800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788851155.473093:0:15423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788851155.473103:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851155.473107:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788851155.473114:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788851155.473301:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851155.473311:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788851155.473317:0:15423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ebbbf6000 1 00000020:00000080:0.0:1788851155.473324:0:15423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205523 00000020:00000080:0.0:1788851155.473333:0:15423:0:(genops.c:885:class_export_put()) final put ffff892eb6c21800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788851155.473376:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788851155.473383:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851155.473388:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788851155.473391:0:15423:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff892ead6d8000) has no exports 00000020:00000080:3.0:1788851155.473449:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea568a800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788851155.473455:0:8:0:(genops.c:885:class_export_put()) final put ffff892ead291000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788851155.473458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ead291000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788851155.473468:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788851155.473653:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6c21800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788851155.524436:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851155.524451:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788851155.524457:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ebbbf0000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788851155.524462:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff892ebbbf0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788851155.524468:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788851155.524592:0:15423:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff892ebbbf7800 00000020:01000000:3.0:1788851155.524613:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788851155.524617:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851155.524622:0:15423:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788851155.524626:0:15423:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff892ec1ca19c0) has no exports 00000100:00100000:1.0:1788851155.530157:0:6535:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff892e89895000:6535] 1 exiting: rc = 0 00000100:00100000:3.0:1788851155.530343:0:6536:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff892e89895c00:6536] 2 exiting: rc = 0 00000100:00100000:3.0:1788851155.530408:0:6534:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff892ead6d2400:6534] 0 exiting: rc = 1 00000100:00100000:0.0:1788851155.530544:0:9543:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff892d87712800:9543] 3 exiting: rc = 0 00000100:00100000:2.0:1788851155.531899:0:10526:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff892d86b0a800:10526] 4 exiting: rc = 0 00000100:00100000:3.0:1788851155.533962:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.533973:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.533979:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.533985:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.533992:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.533997:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534002:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534112:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534117:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534123:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534129:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534135:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534140:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534146:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534152:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534158:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534164:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534364:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534373:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534378:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534385:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534391:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534397:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534403:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534409:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534414:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534420:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534426:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534431:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534437:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534444:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534450:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534456:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534463:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534469:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534474:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534480:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534486:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534492:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534498:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534505:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534511:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534524:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534531:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534536:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534542:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534547:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534553:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534559:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534564:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534570:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534578:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534584:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534590:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534595:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534601:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534606:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534611:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534616:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534621:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534626:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534631:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534636:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.534642:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.542997:0:6538:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff892e8a53ac00:6538] 1 exiting: rc = 0 00000100:00100000:0.0:1788851155.547971:0:6537:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff892e89895600:6537] 0 exiting: rc = 1 00000100:00100000:3.0:1788851155.548352:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548362:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548370:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548377:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548383:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548388:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548396:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548402:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548408:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548413:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548420:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548426:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548434:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548459:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548464:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548469:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548473:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548478:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548483:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548488:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548492:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548497:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548502:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548507:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548512:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548517:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548535:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548540:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548545:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548550:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548555:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548560:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548566:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548571:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548576:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548581:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548586:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548591:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548597:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548602:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548607:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548612:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548617:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548622:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548627:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548632:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548637:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548644:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548657:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548663:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548669:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548674:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548682:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548687:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548692:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548711:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548716:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548720:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548725:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548731:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548736:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548741:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548746:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.548751:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.549477:0:13555:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff892d87a3de00:13555] 2 exiting: rc = 0 00000100:00100000:1.0:1788851155.550796:0:6540:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff892e8ddf0200:6540] 1 exiting: rc = 0 00000100:00100000:0.0:1788851155.551331:0:6539:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff892ec1c84800:6539] 0 exiting: rc = 1 00000100:00100000:3.0:1788851155.551922:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.551932:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.551940:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.551946:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.551952:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.551958:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.551964:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.551970:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.551991:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.551998:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552003:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552009:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552040:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552047:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552053:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552059:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552065:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552071:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552092:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552098:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552116:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552122:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552128:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552134:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552140:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552146:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552152:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552157:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552164:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552176:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552191:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552198:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552218:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552224:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552230:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552237:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552243:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552249:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552256:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552262:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552269:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552275:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552281:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552287:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552305:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552311:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552317:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552323:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552328:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552334:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552340:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552345:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552351:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552363:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552369:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552375:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552394:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552401:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552406:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552412:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552419:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552424:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552431:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.552436:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568193:0:6541:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff892e8ddf1600:6541] 0 exiting: rc = 1 00000100:00100000:3.0:1788851155.568388:0:6542:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff892e867fba00:6542] 1 exiting: rc = 0 00000100:00100000:1.0:1788851155.568490:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568498:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568503:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568508:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568512:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568517:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568522:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568527:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568532:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568538:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568543:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568548:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568554:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568558:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568563:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568569:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568574:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568579:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568597:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568601:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568606:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568612:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568617:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568622:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568626:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568631:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568636:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568642:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568647:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568652:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568657:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568662:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568667:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568672:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568678:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568683:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568687:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568691:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568710:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568715:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568720:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568726:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568731:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568736:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568740:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568746:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568751:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568756:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568773:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568779:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568784:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568789:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568794:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568807:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568811:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568816:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568821:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568825:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568829:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568834:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568839:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568843:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568848:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.568853:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.569417:0:6544:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff892e92d44400:6544] 1 exiting: rc = 0 00000100:00100000:3.0:1788851155.570107:0:6543:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff892e92d45600:6543] 0 exiting: rc = 1 00000100:00100000:1.0:1788851155.570309:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570316:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570321:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570327:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570332:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570338:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570343:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570348:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570355:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570360:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570366:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570370:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570375:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570379:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570384:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570389:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570394:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570399:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570404:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570409:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570413:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570418:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570423:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570429:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570450:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570454:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570459:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570464:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570468:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570474:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570479:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570484:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570489:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570494:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570499:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570504:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570508:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570512:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570517:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570522:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570527:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570531:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570536:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570542:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570547:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570552:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570557:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570562:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570567:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570572:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570577:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570582:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570587:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570592:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570597:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570603:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570608:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570612:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570616:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570629:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570633:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570638:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570642:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851155.570647:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573206:0:6546:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff892ead494800:6546] 1 exiting: rc = 0 00000100:00100000:0.0:1788851155.573582:0:6545:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff892e85ff0a00:6545] 0 exiting: rc = 1 00000100:00100000:3.0:1788851155.573705:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573713:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573718:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573723:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573728:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573733:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573738:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573744:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573749:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573753:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573759:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573774:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573780:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573785:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573790:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573795:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573801:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573805:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573810:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573831:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573836:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573841:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573846:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573851:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573856:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573861:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573866:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573870:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573875:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573880:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573885:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573890:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573895:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573900:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573905:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573909:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573914:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573919:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573924:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573929:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573934:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573938:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573944:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573950:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573955:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573960:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573968:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573973:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573978:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573983:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573987:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573992:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.573997:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574001:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574045:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574050:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574055:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574059:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574064:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574069:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574074:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574079:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574084:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.574089:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851155.576363:0:6547:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff892ead495000:6547] 0 exiting: rc = 1 00000100:00100000:1.0:1788851155.577058:0:6548:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff892ead495800:6548] 1 exiting: rc = 0 00000100:00100000:1.0:1788851155.577248:0:6549:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff892ead494e00:6549] 2 exiting: rc = 0 00000100:00100000:3.0:1788851155.581120:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581133:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581140:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581147:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581153:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581159:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581166:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581185:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581192:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581199:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581233:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581242:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581247:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581253:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581260:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581266:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581272:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581278:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581285:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581292:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581297:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581304:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581311:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581317:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581323:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581345:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581351:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581357:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581362:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581368:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581374:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581380:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581386:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581392:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581415:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581422:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581427:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581433:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581439:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581444:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581450:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581456:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581461:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581466:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581473:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581478:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581483:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581488:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581494:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581499:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581504:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581509:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581515:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581521:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581526:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581532:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581537:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581544:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581550:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581556:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581569:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581575:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581580:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851155.581592:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788851155.595568:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851155.595584:0:15423:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788851155.595590:0:15423:0:(genops.c:885:class_export_put()) final put ffff892ebbbf3800/MDS_uuid 00000020:00000080:1.0:1788851155.595595:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff892ebbbf3800/MDS_uuid for MDS 00000020:01000000:1.0:1788851155.595601:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788851155.596157:0:15423:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788851156.149172:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851157.172302:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851158.199661:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788851158.964869:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788851158.964879:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851158.964883:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788851158.964886:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788851158.964890:0:8:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851158.964899:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 487 00000100:00080000:1.0:1788851158.964905:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788851158.964919:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff892d85c51800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851158.964978:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad6d80 x1875746019776128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851158.965062:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788851158.965066:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788851158.965068:0:8:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851158.965072:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 487 00000100:00080000:1.0:1788851158.965090:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788851158.965095:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892d87492800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851158.965097:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019776128:0@lo:38:kworker.0 00000400:00000100:0.0:1788851158.965150:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019776128 offset 0 length 520: 4 00000100:00100000:2.0:1788851158.965255:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851158.965265:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad6a00 x1875746019776384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851158.965266:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019776256:0@lo:400:kworker.0 00000400:00000100:2.0:1788851158.965290:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019776256 offset 0 length 224: 4 00000100:00100000:2.0:1788851158.965310:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019776512:0@lo:400:kworker.0 00000400:00000100:2.0:1788851158.965326:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019776512 offset 0 length 224: 4 00000100:00100000:0.0:1788851158.965421:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019776384:0@lo:38:kworker.0 00000400:00000100:0.0:1788851158.965439:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019776384 offset 0 length 520: 4 00010000:00010000:1.0:1788851159.221665:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788851159.644300:0:15624:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788851159.659195:0:15624:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788851159.659256:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851159.659273:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851159.659281:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851159.659289:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851159.659309:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788851159.659315:0:15624:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788851159.659340:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788851159.659352:0:15624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea5ad6d80 x1875746019776128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851159.659369:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788851159.659375:0:15624:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788851159.659382:0:15624:0:(import.c:65:import_set_state_nolock()) ffff892d85c51800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788851159.659387:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788851159.659390:0:15624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea5ad6d80 x1875746019776128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851183 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851159.659398:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788851159.659401:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 32s for inflight to error out 00000100:00100000:0.0:1788851159.659505:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019776128:0@lo:38:kworker.0 00010000:00010000:2.0:1788851159.659649:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851159.659656:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851159.659664:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94e00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788851159.659667:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851159.659675:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788851159.659694:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851159.659700:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788851159.659702:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788851159.659704:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788851159.659718:0:6523:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e8a52d800 00010000:00010000:2.0:1788851159.659722:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851159.659729:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff94e00/0x3e0030720b205960 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205967 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851159.659747:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851159.659748:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851159.659750:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788851159.660744:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788851159.660756:0:15624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea5ad4000 x1875746019776256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851174 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851159.660774:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788851159.660779:0:15624:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788851159.660801:0:15624:0:(import.c:65:import_set_state_nolock()) ffff892d85c53800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788851159.661463:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019776640:0@lo:39:umount.0 00000400:00000100:0.0:1788851159.661518:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019776640 offset 0 length 224: 4 00000100:00100000:2.0:1788851159.661720:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019776256:0@lo:400:kworker.0 00000100:00080000:0.0:1788851159.990238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851159.990248:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851159.990251:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851159.990255:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788851159.990434:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851159.990453:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019776768:0@lo:400:kworker.0 00000400:00000100:2.0:1788851159.990504:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019776768 offset 0 length 224: 4 00010000:00010000:1.0:1788851160.244257:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788851161.015099:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788851161.015111:0:9528:0:(genops.c:885:class_export_put()) final put ffff892ea5b9a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788851161.015188:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5b9a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788851161.015253:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea5b99800 for lustre-OST0001 00000001:00100000:3.0:1788851161.015767:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788851161.015771:0:8443:0:(genops.c:885:class_export_put()) final put ffff892d85c53000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788851161.015825:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c53000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788851161.015863:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d85c54000 for lustre-OST0000 00010000:00010000:2.0:1788851161.268552:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851162.296806:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851163.316658:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851164.020221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851164.020232:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851164.020236:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851164.020239:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788851164.020453:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851164.020477:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019776896:0@lo:400:kworker.0 00000400:00000100:3.0:1788851164.020541:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019776896 offset 0 length 224: 4 00010000:00010000:1.0:1788851164.340245:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851165.369696:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851165.812445:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851155/real 1788851155] req@ffff892ea7c35f80 x1875746019776000/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788851165 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851165.812480:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea7c35f80 x1875746019776000/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788851165 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788851165.812501:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e8a52d800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851165.812530:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788851165.812534:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c5226fe-29cd-49fb-9546-e50c12b232cb:3646:1875746019776000:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788851165.817339:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788851165.817360:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788851165.817365:0:36:0:(import.c:65:import_set_state_nolock()) ffff892e8a52d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851165.817373:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 489 00000100:00080000:2.0:1788851165.817379:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.127@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788851165.817393:0:36:0:(import.c:666:import_select_connection()) MGC192.168.204.127@tcp: import ffff892e8a52d800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851165.817431:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c35c00 x1875746019777024/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851165.817468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788851165.817472:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788851165.819928:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851165.819959:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019777152:0@lo:400:kworker.0 00000400:00000100:1.0:1788851165.820066:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019777152 offset 0 length 224: 4 00000100:00100000:0.0:1788851165.821257:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c5226fe-29cd-49fb-9546-e50c12b232cb:3646:1875746019777024:0@lo:250:kworker.0 00000400:00000100:0.0:1788851165.821317:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875746019777024 offset 0 length 520: 4 00010000:00010000:1.0:1788851166.388266:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851167.412641:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851168.436278:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851169.460935:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851169.908982:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851159/real 1788851159] req@ffff892ea5997b80 x1875746019776640/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788851169 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851169.909036:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea5997b80 x1875746019776640/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788851169 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788851169.909054:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c53800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788851169.909087:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019776640:0@lo:39:umount.0 00000100:00080000:3.0:1788851169.909224:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788851169.909230:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788851169.909234:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788851169.910211:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851169.910226:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851169.910234:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851169.910242:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851169.911813:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851169.911833:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851169.911866:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851169.911873:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851169.911887:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851169.915217:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851169.915233:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851169.915245:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7a00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851169.915250:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851169.915261:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851169.915268:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851169.915295:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788851169.915298:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788851169.915314:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e8a52d800 00010000:00010000:1.0:1788851169.915318:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851169.915326:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892d876e7a00/0x3e0030720b20596e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205975 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851169.915344:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851169.915348:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851169.915354:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851169.915357:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851169.915363:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851169.915369:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851169.915374:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788851169.915376:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788851169.915380:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e8a52d800 00010000:00010000:1.0:1788851169.915383:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851169.915400:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851169.915401:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851169.916476:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851169.917105:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851169.917115:0:15624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b205bf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205bf9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851169.917133:0:15624:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788851169.917143:0:15624:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788851169.917146:0:15624:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788851169.917184:0:15624:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788851169.917189:0:15624:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788851169.917198:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851169.917205:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788851169.917209:0:15624:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff892d85c63380) has no exports 00000020:00080000:3.0:1788851169.917239:0:15624:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff892d85c63380) has no exports 00000020:01000000:3.0:1788851169.921415:0:15624:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d875fd6c0 - data ffff892eb370e360/ffff892ea6048800 00000020:01000000:3.0:1788851169.921572:0:15624:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d85fd8960 - data ffff892eb3674288/ffff892ea5794800 00010000:00010000:2.0:1788851169.928785:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788851169.936993:0:15624:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788851169.943926:0:15624:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2056c0 00000020:00000080:2.0:1788851169.943938:0:15624:0:(genops.c:885:class_export_put()) final put ffff892ea568b800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788851169.944131:0:15624:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ea5900800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788851169.944136:0:15624:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea5900800 2 00000020:01000004:2.0:1788851169.944139:0:15624:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892ea5900800 from lustre-OST0000 00000020:00000080:2.0:1788851169.944163:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851169.944172:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788851169.944175:0:15624:0:(genops.c:885:class_export_put()) final put ffff892ea5689800/lustre-OST0000_UUID 00000020:00000080:2.0:1788851169.944179:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5689800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788851169.944185:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788851169.944232:0:15624:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788851169.944237:0:15624:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788851169.944241:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851169.944245:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788851169.944252:0:15624:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff892d85c52800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788851169.944257:0:15624:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff892d85f219c0) has exports, disconnecting them 00000020:00080000:2.0:1788851169.944262:0:15624:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff892d85c52800), last request at 1788850919 00000020:00000080:2.0:1788851169.944266:0:15624:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2056ea 00000020:00080000:2.0:1788851169.944274:0:15624:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d85c52800): rc 0 00000020:00000080:2.0:1788851169.944279:0:15624:0:(genops.c:885:class_export_put()) final put ffff892d85c52800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788851169.944632:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea568b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788851169.954045:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c52800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788851169.968160:0:15624:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788851169.968181:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851169.968186:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788851169.968195:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788851169.968224:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d85c51800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788851169.968412:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851169.968422:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788851169.968428:0:15624:0:(genops.c:885:class_export_put()) final put ffff892d85c56000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788851169.968432:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c56000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788851169.968443:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788851169.968525:0:15624:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788851169.968529:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851169.968534:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788851169.968541:0:15624:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff892d85c57800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788851169.968547:0:15624:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff892d85f23380) has exports, disconnecting them 00000020:00080000:0.0:1788851169.968551:0:15624:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff892d85c57800), last request at 1788850919 00000020:00000080:0.0:1788851169.968555:0:15624:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2056ff 00000020:00080000:0.0:1788851169.968572:0:15624:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d85c57800): rc 0 00000020:00000080:0.0:1788851169.968576:0:15624:0:(genops.c:885:class_export_put()) final put ffff892d85c57800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788851169.968604:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c57800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788851169.969285:0:15624:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788851169.969289:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788851169.969293:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788851169.969297:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851169.969424:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851169.969429:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788851169.969435:0:15624:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea5900800 1 00000020:00000080:1.0:1788851169.969440:0:15624:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205688 00000020:00000080:1.0:1788851169.969445:0:15624:0:(genops.c:885:class_export_put()) final put ffff892ea570a800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788851169.969449:0:15624:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788851169.969453:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851169.969457:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788851169.969459:0:15624:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff892ead6dcd40) has no exports 00000020:00000080:1.0:1788851169.971741:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d85c53800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788851169.971758:0:36:0:(genops.c:885:class_export_put()) final put ffff892d85c54800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788851169.971761:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c54800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788851169.971776:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788851169.971844:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea570a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788851170.107702:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851170.107719:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788851170.107726:0:15624:0:(genops.c:885:class_export_put()) final put ffff892ea5907000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788851170.107731:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5907000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788851170.107745:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788851170.108208:0:15624:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff892ea5904800 00000020:02000400:1.0:1788851170.108280:0:15624:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788851170.484596:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788851171.253833:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788851171.253843:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851171.253846:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788851171.253849:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788851171.253920:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019777280:0@lo:400:kworker.0 00000400:00000100:1.0:1788851171.253973:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019777280 offset 0 length 224: 4 00010000:00010000:0.0:1788851171.508193:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851172.534860:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851173.556309:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788851174.079419:0:15826:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788851174.097393:0:15826:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788851174.097499:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851174.097514:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851174.097521:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851174.097529:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851174.097604:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788851174.097611:0:15826:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788851174.097638:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788851174.097651:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea5ad6a00 x1875746019776384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851174.097674:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788851174.097681:0:15826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788851174.097687:0:15826:0:(import.c:65:import_set_state_nolock()) ffff892d87492800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788851174.097692:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788851174.097696:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea5ad6a00 x1875746019776384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851183 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851174.097703:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788851174.097706:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:0.0:1788851174.097899:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019776384:0@lo:38:kworker.0 00000100:00080000:2.0:1788851174.099228:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788851174.099241:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea5ad5f80 x1875746019776512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851174 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851174.099273:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892e87c37100 x1875746019776768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851175 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851174.099283:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892e87c35880 x1875746019776896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851180 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851174.099361:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea7c34e00 x1875746019777152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851174.099379:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea5ad6680 x1875746019777280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851187 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851174.099386:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788851174.099392:0:15826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788851174.099441:0:15826:0:(import.c:65:import_set_state_nolock()) ffff892d87497800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788851174.099515:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019777280:0@lo:400:kworker.0 00000100:00100000:3.0:1788851174.099525:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019776768:0@lo:400:kworker.0 00000100:00100000:3.0:1788851174.099531:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019776512:0@lo:400:kworker.0 00010000:00010000:1.0:1788851174.099617:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851174.099626:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851174.099636:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebb000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851174.099641:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851174.099652:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851174.099659:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851174.099664:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788851174.099667:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788851174.099670:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788851174.099700:0:6522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e8a52d800 00010000:00010000:1.0:1788851174.099704:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851174.099721:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e9eebb000/0x3e0030720b205944 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b20594b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851174.099735:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851174.099737:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851174.099739:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851174.099754:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019777152:0@lo:400:kworker.0 00000100:00100000:0.0:1788851174.099895:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019776896:0@lo:400:kworker.0 00000100:00100000:0.0:1788851174.099920:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019777408:0@lo:39:umount.0 00000400:00000100:0.0:1788851174.099974:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019777408 offset 0 length 224: 4 00010000:00010000:2.0:1788851174.580603:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851175.606009:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788851176.372371:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788851176.372383:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788851176.631096:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851177.653404:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851178.677464:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851179.700470:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851180.276447:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851165/real 1788851165] req@ffff892ea7c35c00 x1875746019777024/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788851180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851180.276483:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea7c35c00 x1875746019777024/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788851180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788851180.276505:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e8a52d800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851180.276532:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788851180.276536:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c5226fe-29cd-49fb-9546-e50c12b232cb:3646:1875746019777024:0@lo:250:kworker.0 00000100:00080000:2.0:1788851180.277043:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788851180.277049:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788851180.277052:0:8:0:(import.c:65:import_set_state_nolock()) ffff892e8a52d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851180.277058:0:8:0:(import.c:545:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 499 00000100:00080000:2.0:1788851180.277063:0:8:0:(import.c:630:import_select_connection()) MGC192.168.204.127@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788851180.277074:0:8:0:(import.c:666:import_select_connection()) MGC192.168.204.127@tcp: import ffff892e8a52d800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851180.277112:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c35c00 x1875746019777536/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851180.278413:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c5226fe-29cd-49fb-9546-e50c12b232cb:3646:1875746019777536:0@lo:250:kworker.0 00000400:00000100:1.0:1788851180.278469:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875746019777536 offset 0 length 520: 4 00010000:00010000:2.0:1788851180.724243:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851181.748411:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851182.772299:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851183.796360:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851184.372136:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851174/real 1788851174] req@ffff892ea7c34380 x1875746019777408/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788851184 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851184.372175:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea7c34380 x1875746019777408/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788851184 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788851184.372224:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d87497800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788851184.372246:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019777408:0@lo:39:umount.0 00000100:00080000:2.0:1788851184.372336:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788851184.372341:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788851184.372347:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788851184.373488:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851184.373505:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851184.373513:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851184.373537:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851184.373577:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851184.373588:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851184.373596:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851184.373602:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851184.373608:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851184.373629:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788851184.375253:0:15826:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788851184.375301:0:15826:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788851184.375305:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788851184.375371:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851184.375378:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788851184.375384:0:15826:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff892d874a3380) has no exports 00000020:00080000:2.0:1788851184.375414:0:15826:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff892d874a3380) has no exports 00010000:00010000:0.0:1788851184.377313:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851184.377329:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851184.377362:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851184.377366:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851184.377377:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851184.377385:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851184.377390:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851184.377393:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788851184.377396:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788851184.377416:0:6523:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e8a52d800 00010000:00010000:0.0:1788851184.377420:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851184.377427:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892d876e7200/0x3e0030720b205952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205959 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851184.377441:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851184.377445:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851184.377451:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d400 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851184.377454:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851184.377461:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851184.377473:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851184.377494:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788851184.377497:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788851184.377499:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788851184.377515:0:6523:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e8a52d800 00010000:00010000:0.0:1788851184.377519:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851184.377526:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433d400/0x3e0030720b205be4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205beb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851184.377539:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851184.377540:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851184.377542:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851184.378358:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788851184.380840:0:15826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d875fd600 - data ffff892eb370e948/ffff892ea591a000 00000020:01000000:2.0:1788851184.381098:0:15826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892ea7c4d900 - data ffff892eb36e9bd0/ffff892d81b90c00 00100000:10000000:3.0:1788851184.399717:0:15826:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788851184.416765:0:15826:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2057e6 00000020:00000080:2.0:1788851184.416779:0:15826:0:(genops.c:885:class_export_put()) final put ffff892ea55fd000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788851184.416800:0:15826:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ea7c1e800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788851184.416816:0:15826:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea7c1e800 2 00000020:01000004:2.0:1788851184.416819:0:15826:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892ea7c1e800 from lustre-OST0001 00000020:00000080:2.0:1788851184.416844:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851184.416856:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788851184.416860:0:15826:0:(genops.c:885:class_export_put()) final put ffff892ea55fe000/lustre-OST0001_UUID 00000020:00000080:2.0:1788851184.416863:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea55fe000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788851184.416869:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788851184.417048:0:15826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5c5226fe-29cd-49fb-9546-e50c12b232cb->MGS 00010000:00010000:2.0:1788851184.417066:0:15826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ea400/0x3e0030720b20553f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b205546 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788851184.417078:0:15826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea400/0x3e0030720b20553f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b205546 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851184.417084:0:15826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788851184.417087:0:15826:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788851184.417090:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788851184.417103:0:15826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e8a52d800 00010000:00010000:2.0:1788851184.417108:0:15826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ea400/0x3e0030720b20553f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b205546 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851184.417123:0:15826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b2059bb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788851184.417130:0:15826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b2059bb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851184.417149:0:15826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788851184.417151:0:15826:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788851184.417152:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788851184.417163:0:15826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e8a52d800 00010000:00010000:2.0:1788851184.417166:0:15826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433de00/0x3e0030720b2059b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b2059bb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788851184.417191:0:15826:0:(import.c:65:import_set_state_nolock()) ffff892e8a52d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788851184.417195:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788851184.417197:0:15826:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788851184.417199:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788851184.417212:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788851184.417225:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea7c35c00 x1875746019777536/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788851200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788851184.417239:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788851184.417243:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:1.0:1788851184.417793:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c5226fe-29cd-49fb-9546-e50c12b232cb:3646:1875746019777536:0@lo:250:kworker.0 00000020:00000080:0.0:1788851184.417875:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea55fd000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1788851184.418245:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788851184.418256:0:15826:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b20543c 00000020:00000080:2.0:1788851184.418263:0:15826:0:(genops.c:885:class_export_put()) final put ffff892ebbbf1000/5c5226fe-29cd-49fb-9546-e50c12b232cb 00000020:01000000:2.0:1788851184.418273:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.127@tcp (flags='') 00000020:00000080:2.0:1788851184.418278:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851184.418285:0:15826:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.127@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788851184.418289:0:15826:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff892ebbbc99c0) has no exports 00000020:00000080:0.0:1788851184.419289:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ebbbf1000/5c5226fe-29cd-49fb-9546-e50c12b232cb for MGC192.168.204.127@tcp 10000000:01000000:1.0:1788851184.419412:0:6531:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788851184.420722:0:15826:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.127@tcp: client import never connected 00000100:00080000:2.0:1788851184.420730:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788851184.420734:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788851184.420739:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788851184.420747:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788851184.420799:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851184.420853:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892e8a52d800 for MGC192.168.204.127@tcp 00000020:00000080:2.0:1788851184.421229:0:15826:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.127@tcp (uuid 5c5226fe-29cd-49fb-9546-e50c12b232cb) 00000020:00000080:2.0:1788851184.421235:0:15826:0:(genops.c:885:class_export_put()) final put ffff892e82cc2800/5c5226fe-29cd-49fb-9546-e50c12b232cb 00000020:00000080:2.0:1788851184.421239:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff892e82cc2800/5c5226fe-29cd-49fb-9546-e50c12b232cb for MGC192.168.204.127@tcp 00000020:01000000:2.0:1788851184.421246:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.127@tcp (5c5226fe-29cd-49fb-9546-e50c12b232cb) 00000020:01000000:2.0:1788851184.422877:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788851184.422887:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851184.422896:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788851184.422904:0:15826:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff892d87495000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788851184.422921:0:15826:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff892d85c60000) has exports, disconnecting them 00000020:00080000:2.0:1788851184.422926:0:15826:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff892d87495000), last request at 1788850942 00000020:00000080:2.0:1788851184.422931:0:15826:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205810 00000020:00080000:2.0:1788851184.422952:0:15826:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d87495000): rc 0 00000020:00000080:2.0:1788851184.422957:0:15826:0:(genops.c:885:class_export_put()) final put ffff892d87495000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788851184.423694:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d87495000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788851184.427133:0:15826:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788851184.427152:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851184.427157:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788851184.427164:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788851184.427376:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851184.427385:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788851184.427391:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788851184.427398:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851184.427411:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788851184.427418:0:15826:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff892d87493800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788851184.427425:0:15826:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff892d85c619c0) has exports, disconnecting them 00000020:00080000:0.0:1788851184.427429:0:15826:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff892d87493800), last request at 1788850942 00000020:00000080:0.0:1788851184.427433:0:15826:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b205825 00000020:00080000:0.0:1788851184.427448:0:15826:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d87493800): rc 0 00000020:00000080:0.0:1788851184.427453:0:15826:0:(genops.c:885:class_export_put()) final put ffff892d87493800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788851184.428163:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d87492800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788851184.428171:0:8:0:(genops.c:885:class_export_put()) final put ffff892d87494800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788851184.428174:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d87494800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788851184.428185:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788851184.428256:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d87493800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788851184.428276:0:15826:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788851184.428280:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788851184.428282:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788851184.428286:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851184.428300:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d87497800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788851184.428340:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788851184.428434:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788851184.428516:0:6518:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff892e9092e800:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1788851184.428575:0:6517:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff892ebffaec00:6517] 0 exiting: rc = 1 00000100:00100000:1.0:1788851184.428622:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.428877:0:6520:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff892e8a546c00:6520] 1 exiting: rc = 0 00000100:00100000:1.0:1788851184.428932:0:6521:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff892e8a546400:6521] 2 exiting: rc = 0 00000100:00100000:1.0:1788851184.428986:0:6519:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff892ebffaf600:6519] 0 exiting: rc = 1 00000100:00100000:1.0:1788851184.429102:0:7476:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff892eb6cd7000:7476] 3 exiting: rc = 0 00000100:00100000:1.0:1788851184.429167:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429175:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429199:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429217:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429224:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429230:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429237:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429243:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429248:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429254:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429261:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429267:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429272:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429279:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429285:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429291:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429297:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429303:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429308:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429314:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429320:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429325:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429330:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429334:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429339:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429344:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429348:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429353:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429358:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429363:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429369:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429374:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429380:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429385:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429390:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429396:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429401:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429414:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429419:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429423:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429428:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429433:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429437:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429442:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429447:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429452:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429457:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429463:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429467:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429471:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429476:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429481:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429486:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429492:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429497:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429503:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429507:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429512:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429517:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429523:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429527:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429532:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429537:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.429542:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788851184.432703:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851184.432720:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788851184.432727:0:15826:0:(genops.c:885:class_export_put()) final put ffff892d87497000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788851184.432732:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff892d87497000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788851184.432739:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788851184.432798:0:15826:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea7c1e800 1 00000020:00000080:1.0:1788851184.432805:0:15826:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2057b5 00000020:00000080:1.0:1788851184.432824:0:15826:0:(genops.c:885:class_export_put()) final put ffff892d85c57000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788851184.432839:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788851184.432850:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c57000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788851184.432862:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851184.432867:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788851184.432871:0:15826:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff892d85c64d40) has no exports 00000020:00000080:1.0:1788851184.681154:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851184.681171:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788851184.681178:0:15826:0:(genops.c:885:class_export_put()) final put ffff892ea7c1e000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788851184.681184:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea7c1e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788851184.681191:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788851184.681529:0:15826:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff892ea7c1a800 00000020:01000000:1.0:1788851184.681557:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788851184.681562:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851184.681567:0:15826:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788851184.681572:0:15826:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff892eb6f419c0) has no exports 00000020:00000080:1.0:1788851184.681597:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851184.681602:0:15826:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788851184.681605:0:15826:0:(genops.c:885:class_export_put()) final put ffff892ea570c000/OSS_uuid 00000020:00000080:1.0:1788851184.681607:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea570c000/OSS_uuid for OSS 00000020:01000000:1.0:1788851184.681611:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788851184.681695:0:8449:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff892ea573b000:8449] 1 exiting: rc = 0 00000100:00100000:2.0:1788851184.681717:0:8447:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff892ea573ee00:8447] 0 exiting: rc = 1 00000100:00100000:1.0:1788851184.681963:0:8450:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff892ea5760600:8450] 2 exiting: rc = 0 00000100:00080000:0.0:1788851184.682135:0:6530:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788851184.683405:0:8625:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff892ea55cc400:8625] 3 exiting: rc = 0 00000100:00100000:1.0:1788851184.683501:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683511:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683517:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683523:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683530:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683537:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683544:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683550:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683556:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683561:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683580:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683585:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683591:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683597:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683602:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683607:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683613:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683617:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683623:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683628:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683634:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683639:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683645:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683650:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683655:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683661:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683666:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683671:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683677:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683682:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683688:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683693:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683698:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683703:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683707:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683712:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683717:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683723:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683728:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683732:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683738:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683742:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683747:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683752:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683757:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683770:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683775:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683780:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683785:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683790:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683795:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683801:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683806:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683811:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683816:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683821:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683825:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683829:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683834:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683838:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683843:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683847:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683852:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.683931:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685139:0:8452:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff892ea5760800:8452] 1 exiting: rc = 0 00000100:00100000:3.0:1788851184.685377:0:12687:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff892ea59f5000:12687] 2 exiting: rc = 0 00000100:00100000:3.0:1788851184.685470:0:8451:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff892ea5760200:8451] 0 exiting: rc = 1 00000100:00100000:1.0:1788851184.685548:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685560:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685568:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685573:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685578:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685584:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685590:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685596:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685602:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685610:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685616:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685622:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685657:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685662:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685668:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685691:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685697:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685702:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685709:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685714:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685720:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685725:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685731:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685736:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685741:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685745:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685751:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685757:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685762:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685767:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685772:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685777:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685783:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685788:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685792:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685797:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685803:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685808:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685814:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685820:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685825:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685830:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685835:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685840:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685844:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685850:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685855:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685941:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685947:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685952:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685965:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685970:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685976:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685981:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685987:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685992:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.685999:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.686004:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.686043:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.686051:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.686062:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.686070:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.686076:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.686084:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851184.689244:0:8455:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff892ea5679000:8455] 2 exiting: rc = 0 00000100:00100000:2.0:1788851184.689723:0:8453:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff892ea5760a00:8453] 0 exiting: rc = 1 00000100:00100000:2.0:1788851184.690035:0:8454:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff892ea5678c00:8454] 1 exiting: rc = 0 00000100:00100000:1.0:1788851184.690186:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690208:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690215:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690221:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690226:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690231:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690237:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690243:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690249:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690255:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690262:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690268:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690273:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690278:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690284:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690289:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690369:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690376:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690396:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690468:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690475:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690499:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690504:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690511:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690517:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690524:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690530:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690537:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690542:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690549:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690555:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690561:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690568:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690574:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690580:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690586:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690592:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690597:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690602:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690608:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690613:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690620:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690641:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690649:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690655:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690661:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690667:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690673:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690678:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690684:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690690:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690696:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690704:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690709:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690715:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690721:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690734:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690740:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690746:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690752:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690757:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690762:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690769:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.690783:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851184.697832:0:8456:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff892ea542de00:8456] 0 exiting: rc = 1 00000100:00100000:3.0:1788851184.698252:0:8457:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff892ea542c000:8457] 1 exiting: rc = 0 00000100:00100000:1.0:1788851184.698438:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698447:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698452:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698458:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698463:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698469:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698474:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698479:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698485:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698490:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698496:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698501:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698506:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698511:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698517:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698522:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698528:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698533:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698539:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698545:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698551:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698556:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698562:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698567:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698572:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698577:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698582:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698605:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698611:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698616:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698622:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698628:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698633:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698639:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698644:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698649:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698654:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698658:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698663:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698669:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698675:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698680:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698684:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698689:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698694:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698698:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698704:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698709:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698715:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698720:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698725:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698730:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698736:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698741:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698746:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698751:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698756:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698762:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698768:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698773:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698778:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698783:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698798:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851184.698803:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851184.700171:0:8459:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff892ea5679e00:8459] 1 exiting: rc = 0 00000100:00100000:3.0:1788851184.700709:0:8458:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff892eb6ce5200:8458] 0 exiting: rc = 1 00000100:00100000:2.0:1788851184.700950:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.700982:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.700990:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.700996:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701003:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701009:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701034:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701039:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701045:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701051:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701057:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701062:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701068:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701089:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701096:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701103:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701109:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701115:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701121:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701127:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701133:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701139:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701145:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701151:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701169:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701191:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701209:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701216:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701222:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701228:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701235:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701243:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701250:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701256:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701262:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701269:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701276:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701305:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701313:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701319:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701325:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701342:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701349:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701354:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701359:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701365:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701372:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701377:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701386:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701407:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701415:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701422:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701428:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701434:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701440:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701446:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701452:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701458:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701464:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701477:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701483:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701490:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701496:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851184.701511:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788851184.710712:0:15826:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788851206.053945:0:16591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788851215.065637:0:17191:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788851215.065643:0:17191:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788851215.065644:0:17191:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788851215.065766:0:17191:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892e84cde000 00000020:01000004:3.0:1788851215.065782:0:17191:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788851215.065789:0:17191:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788851215.065804:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff892d85f20000) 00000020:00000080:3.0:1788851215.065817:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788851215.143710:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788851215.144973:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.146313:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.148134:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.148512:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.148798:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.149101:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.149457:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.149697:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.149911:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.150126:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.150500:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.150779:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.150992:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.151435:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.151666:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.151882:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.152104:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.152435:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.152663:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.152839:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.153159:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.153494:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.153758:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.153949:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.154162:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.154456:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.154697:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.154888:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.155126:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.155592:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.155800:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.155993:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.156660:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788851215.156844:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788851215.158341:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788851215.158843:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.159128:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788851215.159511:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.159794:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788851215.160006:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.160313:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788851215.160633:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.160808:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.160984:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788851215.161423:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788851215.161670:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.162623:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.162913:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.164506:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.165338:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.165772:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788851215.165958:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1788851215.166931:0:17191:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788851215.167450:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788851215.167459:0:17191:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788851215.167473:0:17191:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b2069eb 00000020:01000004:2.0:1788851215.167480:0:17191:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788851215.167485:0:17191:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788851215.167490:0:17191:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892e84cde000 from MGS 00000020:01000004:2.0:1788851215.167494:0:17191:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788851215.167505:0:17191:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff892d87ac0000) 00000020:00000080:2.0:1788851215.167516:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788851215.167659:0:17191:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892e84cde000 from MGS, refs=2 00080000:01000000:2.0:1788851215.167665:0:17191:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788851215.167670:0:17191:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b2069f9 00000100:00100000:2.0:1788851215.167770:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788851215.167900:0:17191:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788851215.167907:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788851215.168653:0:17191:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788851215.168663:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788851215.169506:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788851215.169744:0:17191:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788851215.169750:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788851215.170266:0:17191:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788851215.170273:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788851215.170695:0:17191:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788851215.170701:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788851215.171647:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851215.171651:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851215.171653:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851215.171913:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851215.171916:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851215.171918:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851215.172735:0:17191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:0.0:1788851215.178276:0:17191:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:3.0:1788851215.179621:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788851215.181547:0:17203:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788851215.182287:0:17191:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788851215.182346:0:17191:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788851215.188507:0:17191:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788851215.188823:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788851215.189002:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788851215.189008:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788851215.190789:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788851215.190804:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788851215.191131:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788851215.191138:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788851215.191844:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788851215.191864:0:17191:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.127@tcp' 00000020:01000004:3.0:1788851215.191866:0:17191:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788851215.191896:0:17191:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.127@tcp (typ=mgc) 00000020:00000080:3.0:1788851215.191907:0:17191:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.127@tcp (ffff892d85f23380) 00000020:00000080:3.0:1788851215.191922:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788851215.191994:0:17191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892e983ab000@MGC192.168.204.127@tcp: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1788851215.192187:0:17191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.127@tcp-0 is initialized 00000040:01000000:3.0:1788851215.192193:0:17191:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788851215.194180:0:17209:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788851215.194314:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.127@tcp (uuid 6a8a82bd-f416-4736-bb65-b562856c988b) 00000020:00000080:3.0:1788851215.194335:0:17191:0:(genops.c:1384:class_connect()) connect: client 6a8a82bd-f416-4736-bb65-b562856c988b, cookie 0x3e0030720b206a07 00000100:00080000:3.0:1788851215.194346:0:17191:0:(import.c:545:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788851215.194358:0:17191:0:(import.c:666:import_select_connection()) MGC192.168.204.127@tcp: import ffff892e983ab000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851215.194390:0:17191:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5995c00 x1875746019777664/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851215.194424:0:17191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6a8a82bd-f416-4736-bb65-b562856c988b->MGS 00000020:01000004:3.0:1788851215.194446:0:17191:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788851215.194452:0:17191:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788851215.194464:0:17191:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff892d85f219c0) 00000020:00000080:3.0:1788851215.194476:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788851215.195682:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a8a82bd-f416-4736-bb65-b562856c988b:3646:1875746019777664:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788851215.195751:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851215.200172:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019777664 00000100:00100000:0.0:1788851215.200189:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019777664 00000100:00100000:0.0:1788851215.200234:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851215.200245:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875746019777664:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788851215.200276:0:17205:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6a8a82bd-f416-4736-bb65-b562856c988b@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:0.0:1788851215.200312:0:17205:0:(genops.c:1384:class_connect()) connect: client 6a8a82bd-f416-4736-bb65-b562856c988b, cookie 0x3e0030720b206a15 00000100:00080000:0.0:1788851215.200456:0:17205:0:(import.c:65:import_set_state_nolock()) ffff892ea568c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851215.200572:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+5:3646:x1875746019777664:12345-0@lo:250:mount.lustre.0 Request processed in 327us (4819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851215.200592:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851215.200761:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788851215.200771:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.127@tcp: connect to target with instance 0 00000100:00080000:0.0:1788851215.200778:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788851215.200783:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788851215.200786:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e983ab000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788851215.200788:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788851215.200798:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788851215.200803:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a8a82bd-f416-4736-bb65-b562856c988b:3646:1875746019777664:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1788851215.200879:0:17208:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788851215.209246:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788851215.209429:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788851215.209436:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788851215.210410:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788851215.210421:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788851215.212962:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788851215.212974:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788851215.214085:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851215.214332:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788851215.214338:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788851215.215674:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788851215.215683:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788851215.250369:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851215.250689:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788851215.250697:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788851215.252274:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788851215.252285:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788851215.252801:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851215.253267:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788851215.253273:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788851215.253723:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788851215.253730:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788851215.254529:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851215.254756:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788851215.254762:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788851215.255498:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788851215.255505:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788851215.256264:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851215.256417:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788851215.256422:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788851215.256936:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788851215.256943:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788851215.277316:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788851215.277531:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788851215.277615:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788851215.279489:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788851215.279501:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788851215.280393:0:17191:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788851215.280403:0:17191:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788851215.281374:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788851215.281401:0:17191:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788851215.281407:0:17191:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788851215.281506:0:17191:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788851215.281614:0:17191:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788851215.281620:0:17191:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788851215.281621:0:17191:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788851215.281623:0:17191:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851215.281624:0:17191:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851215.281626:0:17191:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851215.281627:0:17191:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851215.281628:0:17191:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788851215.281630:0:17191:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788851215.281631:0:17191:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851215.281633:0:17191:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788851215.281635:0:17191:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788851215.281638:0:17191:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788851215.281643:0:17191:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788851215.281645:0:17191:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851215.281646:0:17191:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851215.281647:0:17191:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851215.281648:0:17191:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851215.281649:0:17191:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788851215.281650:0:17191:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788851215.281651:0:17191:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851215.281652:0:17191:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788851215.281685:0:17191:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788851215.281703:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019777792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788851215.281771:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851215.281819:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851215.281903:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019777792 00000100:00100000:1.0:1788851215.281910:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019777792 00000100:00100000:1.0:1788851215.281956:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788851215.281965:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+5:17191:x1875746019777792:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788851215.282038:0:17207:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788851215.282045:0:17207:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788851215.282048:0:17207:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788851215.282832:0:17228:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788851215.283646:0:17207:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788851215.284924:0:17229:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788851215.284930:0:17229:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788851215.284933:0:17229:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788851215.284936:0:17229:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788851215.285487:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788851215.285688:0:17207:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788851215.285699:0:17207:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788851215.287444:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+5:17191:x1875746019777792:12345-0@lo:253:mount.lustre.0 Request processed in 5472us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851215.287459:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851215.287612:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019777792:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788851215.287627:0:17191:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788851215.287631:0:17191:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788851215.287633:0:17191:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788851215.287635:0:17191:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851215.287636:0:17191:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851215.287638:0:17191:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851215.287639:0:17191:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851215.287641:0:17191:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788851215.287642:0:17191:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788851215.287644:0:17191:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851215.287645:0:17191:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788851215.287663:0:17191:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892e84cde000 from lustre-MDT0000 10000000:01000000:0.0:1788851215.287691:0:17191:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788851215.287694:0:17191:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788851215.287698:0:17191:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff892d85f23380 10000000:01000000:0.0:1788851215.287703:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788851215.287711:0:17191:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff892d85f23380 from 1 10000000:01000000:0.0:1788851215.287714:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788851215.287749:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851215.287773:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851215.287783:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851215.287802:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019777920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851215.287834:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851215.287915:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788851215.287965:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019777920 00000100:00100000:2.0:1788851215.287972:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019777920 00000100:00100000:2.0:1788851215.288126:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851215.288136:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+5:17191:x1875746019777920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851215.288155:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851215.288178:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e7a00/0x3e0030720b206a23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206a1c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.288202:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e7a00/0x3e0030720b206a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206a1c expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.288212:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e7a00/0x3e0030720b206a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206a1c expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.288221:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7a00, rc 0) 00000100:00100000:2.0:1788851215.288250:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+6:17191:x1875746019777920:12345-0@lo:101:mount.lustre.0 Request processed in 117us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851215.288257:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851215.288318:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019777920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851215.288331:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.288340:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.288392:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851215.288417:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.288593:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebbb4c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851215.288727:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019778048 00000100:00100000:0.0:1788851215.288733:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019778048 00000100:00100000:0.0:1788851215.288757:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851215.288763:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+6:17191:x1875746019778048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851215.288840:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+6:17191:x1875746019778048:12345-0@lo:501:mount.lustre.0 Request processed in 77us (421us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788851215.288848:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851215.288954:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778048:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788851215.288983:0:17191:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788851215.289001:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.289029:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851215.289038:0:17191:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892e84cde000 10000000:01000000:1.0:1788851215.289042:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788851215.289046:0:17191:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff892e84cde000 10000000:01000000:1.0:1788851215.289055:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788851215.289059:0:17191:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff892e84cde000 from 1 10000000:01000000:1.0:1788851215.289061:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788851215.289079:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.289087:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.289095:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.289108:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851215.289133:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.289154:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebbb4c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851215.289289:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019778176 00000100:00100000:2.0:1788851215.289294:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019778176 00000100:00100000:2.0:1788851215.289324:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788851215.289331:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+6:17191:x1875746019778176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851215.289339:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851215.289350:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6c00/0x3e0030720b206a31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206a2a expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.289367:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6c00/0x3e0030720b206a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206a2a expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.289377:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6c00/0x3e0030720b206a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206a2a expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.289384:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6c00, rc 0) 00000100:00100000:2.0:1788851215.289497:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+7:17191:x1875746019778176:12345-0@lo:101:mount.lustre.0 Request processed in 166us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851215.289504:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788851215.289641:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851215.289652:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.289661:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851215.289672:0:17191:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788851215.289720:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.289728:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851215.289735:0:17191:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788851215.289743:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788851215.289749:0:17191:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff892e84cde000 10000000:01000000:1.0:1788851215.289752:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788851215.289755:0:17191:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788851215.289757:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788851215.289772:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.289780:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.289787:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.289799:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851215.289825:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.289854:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebbb4c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.289924:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019778304 00000100:00100000:3.0:1788851215.289929:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019778304 00000100:00100000:3.0:1788851215.289957:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851215.289964:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+7:17191:x1875746019778304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851215.289972:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851215.289981:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e8a8b8600/0x3e0030720b206a3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206a38 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.289996:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e8a8b8600/0x3e0030720b206a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206a38 expref: 8 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.290005:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e8a8b8600/0x3e0030720b206a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206a38 expref: 8 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.290030:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8600, rc 0) 00000100:00100000:3.0:1788851215.290059:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+8:17191:x1875746019778304:12345-0@lo:101:mount.lustre.0 Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.290064:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788851215.290141:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851215.290151:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.290158:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.290213:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851215.290235:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.290259:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebbb4c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.290356:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019778432 00000100:00100000:3.0:1788851215.290361:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019778432 00000100:00100000:3.0:1788851215.290387:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851215.290393:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+8:17191:x1875746019778432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851215.290500:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+9:17191:x1875746019778432:12345-0@lo:501:mount.lustre.0 Request processed in 107us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.290508:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788851215.290686:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851215.290722:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851215.290758:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.290779:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebbb4c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.290826:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019778560 00000100:00100000:3.0:1788851215.290830:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019778560 00000100:00100000:3.0:1788851215.290858:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851215.290864:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+9:17191:x1875746019778560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851215.291569:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+9:17191:x1875746019778560:12345-0@lo:503:mount.lustre.0 Request processed in 702us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.291577:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788851215.291710:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019778560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851215.292081:0:17230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17230:1875746019778688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851215.292119:0:17230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.292148:0:17230:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebbb4cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.292289:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019778688 00000100:00100000:3.0:1788851215.292296:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019778688 00000100:00100000:3.0:1788851215.292323:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851215.292330:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+9:17230:x1875746019778688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851215.292799:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+9:17230:x1875746019778688:12345-0@lo:502:llog_process_th.0 Request processed in 469us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.292808:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851215.292957:0:17230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17230:1875746019778688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788851215.292986:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851215.292996:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851215.292998:0:17230:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788851215.293004:0:17230:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788851215.293006:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788851215.293048:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff892d874a0000) 00000020:00000080:1.0:1788851215.293063:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788851215.293069:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788851215.293141:0:17230:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788851215.293148:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b206a4d 00000020:00000080:1.0:1788851215.293413:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788851215.293418:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851215.293421:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851215.293422:0:17230:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788851215.293425:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851215.293428:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851215.293430:0:17230:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788851215.293432:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788851215.293439:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff892d874a19c0) 00000020:00000080:1.0:1788851215.293447:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788851215.293457:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788851215.293459:0:17230:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788851215.293461:0:17230:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788851215.293467:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788851215.293507:0:17230:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892e84cde000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788851215.293520:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff892d874a3380) 00000020:00000080:1.0:1788851215.293528:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788851215.293666:0:17230:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788851215.293672:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b206a62 00000020:00000080:1.0:1788851215.293755:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788851215.293761:0:17230:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788851215.293765:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e0030720b206a69 00080000:01000000:1.0:1788851215.293770:0:17230:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788851215.293773:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b206a70 00010000:00010000:2.0:1788851215.350669:0:17230:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788851215.351378:0:17230:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1788851215.351660:0:17230:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788851215.352215:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff892d87ac19c0) 00000020:00000080:2.0:1788851215.352231:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788851215.352293:0:17230:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788851215.352300:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b206a7e 00000020:00000080:1.0:1788851215.354437:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788851215.361946:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e0030720b206a85 00000020:00000080:1.0:1788851215.363304:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788851215.363317:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851215.363324:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851215.363326:0:17230:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788851215.363330:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788851215.363333:0:17230:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788851215.363335:0:17230:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788851215.363336:0:17230:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788851215.363338:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788851215.363340:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851215.363342:0:17230:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788851215.363344:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851215.363349:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851215.363350:0:17230:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788851215.363355:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788851215.363392:0:17230:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788851215.363406:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851215.363415:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851215.363417:0:17230:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788851215.363420:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851215.363423:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851215.363425:0:17230:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788851215.363428:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788851215.363434:0:17230:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:1.0:1788851215.363458:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788851215.363474:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff892d874a4d40) 00000020:00000080:1.0:1788851215.363489:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788851215.363494:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788851215.363546:0:17230:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788851215.363552:0:17230:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788851215.363557:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b206a93 00010000:00080000:1.0:1788851215.363588:0:17230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892ea576a000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1788851215.365172:0:17230:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788851215.370126:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851215.370141:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788851215.370189:0:17230:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788851215.370214:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b206a9a 00000100:00080000:0.0:1788851215.370225:0:17230:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851215.370236:0:17230:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892ea576a000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851215.370272:0:17230:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c34700 x1875746019778816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851215.370305:0:17230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788851215.370354:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851215.370364:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.370366:0:17230:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788851215.370369:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788851215.370371:0:17230:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788851215.370373:0:17230:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851215.370374:0:17230:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851215.370376:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788851215.370378:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.370379:0:17230:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788851215.370381:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788851215.370386:0:17230:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788851215.370389:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.370390:0:17230:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788851215.370392:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788851215.370396:0:17230:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:0.0:1788851215.370417:0:17230:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788851215.370420:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851215.370432:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff892ebbbcb380) 00000020:00000080:0.0:1788851215.370444:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788851215.370449:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788851215.370501:0:17230:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788851215.370507:0:17230:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788851215.370512:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b206aa8 00010000:00080000:0.0:1788851215.370676:0:17230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892ea5769000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788851215.370944:0:17230:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788851215.371272:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019778816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788851215.371335:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851215.371405:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019778816 00000100:00100000:3.0:1788851215.371413:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019778816 00000100:00100000:3.0:1788851215.371440:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851215.371448:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019778816:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788851215.371464:0:17217:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1788851215.374911:0:17230:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788851215.375153:0:17230:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788851215.378929:0:17230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851215.379448:0:17230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788851215.388300:0:17230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788851215.395207:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788851215.395217:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788851215.397172:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019778816:12345-0@lo:38:llog_process_th.0 Request processed in 25701us (25814us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851215.397194:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788851215.397247:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851215.397252:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851215.397257:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019778816:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1788851215.398917:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788851215.398932:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788851215.398974:0:17230:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788851215.398994:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b206aaf 00000100:00080000:3.0:1788851215.399004:0:17230:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788851215.399041:0:17230:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff892ea5769000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851215.399078:0:17230:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5994700 x1875746019778944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851215.399101:0:17230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788851215.399178:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851215.399183:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851215.399185:0:17230:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788851215.399188:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788851215.399191:0:17230:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788851215.399193:0:17230:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788851215.399195:0:17230:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788851215.399196:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788851215.399198:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851215.399200:0:17230:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788851215.399202:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788851215.399207:0:17230:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788851215.399210:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851215.399211:0:17230:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788851215.399214:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788851215.399218:0:17230:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1788851215.399239:0:17230:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788851215.399241:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788851215.399253:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff892d85f24d40) 00000020:00000080:3.0:1788851215.399263:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788851215.399267:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788851215.399325:0:17230:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788851215.399331:0:17230:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788851215.399336:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b206abd 00010000:00080000:3.0:1788851215.399376:0:17230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892e88540000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1788851215.399577:0:17230:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788851215.399663:0:17230:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788851215.399680:0:17230:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788851215.400110:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019778944:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788851215.400221:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019778944 offset 0 length 520: 4 00000040:00080000:3.0:1788851215.403114:0:17230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851215.403472:0:17230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788851215.403688:0:17230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788851215.404428:0:17238:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788851215.404433:0:17238:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788851215.406796:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788851215.406811:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788851215.406854:0:17230:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788851215.406876:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b206ac4 00000100:00080000:3.0:1788851215.406888:0:17230:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788851215.406900:0:17230:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892e88540000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851215.406941:0:17230:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5996d80 x1875746019779072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851215.407042:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019779072:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788851215.407099:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019779072 offset 0 length 520: 4 00000100:00080000:3.0:1788851215.407325:0:17230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788851215.407384:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851215.407389:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851215.407390:0:17230:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788851215.407394:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851215.407398:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851215.407400:0:17230:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788851215.407403:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788851215.407404:0:17230:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788851215.407407:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851215.407409:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851215.407411:0:17230:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788851215.407413:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851215.407415:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851215.407417:0:17230:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788851215.407421:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788851215.407448:0:17230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17230:1875746019779200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851215.407501:0:17230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851215.407661:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019779200 00000100:00100000:3.0:1788851215.407675:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019779200 00000100:00100000:3.0:1788851215.407757:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788851215.407766:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+9:17230:x1875746019779200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851215.407886:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+9:17230:x1875746019779200:12345-0@lo:502:llog_process_th.0 Request processed in 120us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.407894:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788851215.408140:0:17230:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d85ed0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788851215.408173:0:17230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17230:1875746019779200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851215.408200:0:17230:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851215.408205:0:17230:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851215.408207:0:17230:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788851215.408211:0:17230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788851215.408264:0:17191:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788851215.408282:0:17191:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788851215.408300:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.408319:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851215.408328:0:17191:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e84cde000 from 1 10000000:01000000:2.0:1788851215.408332:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788851215.408360:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.408369:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.408379:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851215.408393:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851215.408424:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.408821:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993000 going to sleep for 11 seconds 00000100:00100000:1.0:1788851215.408950:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019779328 00000100:00100000:1.0:1788851215.408957:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019779328 00000100:00100000:1.0:1788851215.408986:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851215.408993:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8678a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+9:17191:x1875746019779328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851215.409003:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851215.409039:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206acb expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.409061:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206acb expref: 10 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.409073:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206acb expref: 10 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.409081:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030400, rc 0) 00000100:00100000:1.0:1788851215.409129:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8678a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+10:17191:x1875746019779328:12345-0@lo:101:mount.lustre.0 Request processed in 136us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851215.409135:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788851215.409267:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851215.409281:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.409291:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851215.409968:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779456:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788851215.410046:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.410067:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.410152:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019779456 00000100:00100000:3.0:1788851215.410158:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019779456 00000100:00100000:3.0:1788851215.410197:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851215.410204:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8678a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+10:17191:x1875746019779456:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788851215.410219:0:17205:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788851215.410225:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788851215.410300:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8678a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+10:17191:x1875746019779456:12345-0@lo:256:mount.lustre.0 Request processed in 96us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.410309:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788851215.410451:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779456:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788851215.411083:0:17191:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788851215.411110:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.411121:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851215.411130:0:17191:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e84cde000 from 1 10000000:01000000:2.0:1788851215.411132:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851215.411173:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.411181:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.411191:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851215.411207:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851215.411244:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.411261:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.411512:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019779584 00000100:00100000:3.0:1788851215.411518:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019779584 00000100:00100000:3.0:1788851215.411554:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788851215.411561:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+10:17191:x1875746019779584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851215.411571:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851215.411585:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206ad9 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.411616:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206ad9 expref: 11 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.411627:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206ad9 expref: 11 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.411651:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8e00, rc 0) 00000100:00100000:3.0:1788851215.411781:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+11:17191:x1875746019779584:12345-0@lo:101:mount.lustre.0 Request processed in 219us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.411788:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851215.411952:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851215.411966:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.411975:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851215.412075:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851215.412102:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.412126:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.412186:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019779712 00000100:00100000:3.0:1788851215.412191:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019779712 00000100:00100000:3.0:1788851215.412217:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788851215.412223:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+11:17191:x1875746019779712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851215.412359:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+11:17191:x1875746019779712:12345-0@lo:501:mount.lustre.0 Request processed in 135us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.412366:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851215.412481:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851215.412507:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851215.412556:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.412573:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.412672:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019779840 00000100:00100000:3.0:1788851215.412676:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019779840 00000100:00100000:3.0:1788851215.412767:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788851215.412775:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+11:17191:x1875746019779840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851215.412856:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+11:17191:x1875746019779840:12345-0@lo:503:mount.lustre.0 Request processed in 81us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.412862:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788851215.412930:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019779840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851215.413407:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17240:1875746019779968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851215.413442:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.413463:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.413499:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019779968 00000100:00100000:3.0:1788851215.413504:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019779968 00000100:00100000:3.0:1788851215.413633:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788851215.413643:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+11:17240:x1875746019779968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851215.414509:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+11:17240:x1875746019779968:12345-0@lo:502:llog_process_th.0 Request processed in 864us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851215.414663:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17240:1875746019779968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788851215.414713:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851215.414723:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.414725:0:17240:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788851215.414733:0:17240:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892e84cde000 00000020:00000080:0.0:1788851215.414735:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788851215.414744:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851215.414747:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.414748:0:17240:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788851215.414751:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851215.414754:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.414756:0:17240:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788851215.414759:0:17240:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892e84cde000 00000020:00000080:0.0:1788851215.414761:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788851215.414831:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851215.414834:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.414836:0:17240:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788851215.414839:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851215.414841:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.414843:0:17240:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788851215.414847:0:17240:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892e84cde000 00000020:00000080:0.0:1788851215.414849:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788851215.414867:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851215.414869:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.414871:0:17240:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788851215.414873:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851215.414875:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.414877:0:17240:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788851215.414880:0:17240:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892e84cde000 00000020:00000080:0.0:1788851215.414881:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788851215.414919:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c37800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17240:1875746019780096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851215.414960:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851215.414985:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851215.420711:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019780096 00000100:00100000:1.0:1788851215.420727:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019780096 00000100:00100000:1.0:1788851215.420768:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788851215.420777:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17240:x1875746019780096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851215.420985:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17240:x1875746019780096:12345-0@lo:502:llog_process_th.0 Request processed in 207us (6023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851215.420992:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851215.421363:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c37800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17240:1875746019780096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788851215.421398:0:17240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851215.421406:0:17240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851215.421408:0:17240:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788851215.421413:0:17240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788851215.421659:0:17191:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788851215.421680:0:17191:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851215.421762:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.421773:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851215.421826:0:17191:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788851215.421829:0:17191:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892e84cde000 10000000:01000000:1.0:1788851215.421833:0:17191:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892e84cde000 10000000:01000000:1.0:1788851215.421839:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788851215.421845:0:17191:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892e84cde000 from 1 10000000:01000000:1.0:1788851215.421848:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788851215.421885:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.421895:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.421916:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.421938:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019780224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851215.421986:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.422036:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e914dc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851215.422057:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019780224 00000100:00100000:1.0:1788851215.422062:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019780224 00000100:00100000:1.0:1788851215.422085:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788851215.422092:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17191:x1875746019780224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851215.422103:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851215.422114:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80030e00/0x3e0030720b206aee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206ae7 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.422136:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80030e00/0x3e0030720b206aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206ae7 expref: 13 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.422146:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80030e00/0x3e0030720b206aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206ae7 expref: 13 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.422153:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030e00, rc 0) 00000100:00100000:3.0:1788851215.422656:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788851215.424572:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17191:x1875746019780224:12345-0@lo:101:mount.lustre.0 Request processed in 2471us (2577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851215.424584:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788851215.432866:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019780224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851215.432906:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.432922:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851215.438916:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019780352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851215.439003:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851215.439063:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019780352 00000100:00100000:3.0:1788851215.439071:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019780352 00000100:00100000:3.0:1788851215.439118:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788851215.439126:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:17191:x1875746019780352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851215.440883:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:17191:x1875746019780352:12345-0@lo:501:mount.lustre.0 Request processed in 1746us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.440900:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788851215.440994:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d85ed0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.441044:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019780352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851215.441119:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019780480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851215.442810:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851215.442871:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d85ed0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851215.442961:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019780480 00000100:00100000:0.0:1788851215.442974:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019780480 00000100:00100000:0.0:1788851215.443057:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788851215.443067:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17191:x1875746019780480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851215.443917:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17191:x1875746019780480:12345-0@lo:503:mount.lustre.0 Request processed in 846us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851215.443927:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788851215.444686:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019780480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851215.450509:0:17245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c37800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17245:1875746019780608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851215.450622:0:17245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851215.450678:0:17245:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.450795:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019780608 00000100:00100000:3.0:1788851215.450806:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019780608 00000100:00100000:3.0:1788851215.450870:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788851215.450881:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:17245:x1875746019780608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851215.451068:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:17245:x1875746019780608:12345-0@lo:502:llog_process_th.0 Request processed in 188us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.451077:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788851215.451345:0:17245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c37800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17245:1875746019780608:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788851215.451424:0:17245:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788851215.451440:0:17245:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff892ebbbc8000) 00000020:00000080:0.0:1788851215.451461:0:17245:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788851215.451574:0:17245:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892e84cde000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788851215.451579:0:17245:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892e84cde000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788851215.451582:0:17245:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892e84cde000 4 00010000:00080000:0.0:1788851215.451623:0:17245:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892ea5569800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788851215.456988:0:17245:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788851215.457205:0:17245:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788851215.457248:0:17245:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788851215.458537:0:17245:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e0030720b206afc 00000100:00080000:0.0:1788851215.458565:0:17245:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851215.458578:0:17245:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff892ea5569800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851215.460614:0:17245:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c37800 x1875746019780736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851215.460655:0:17245:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788851215.460951:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019780736:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788851215.461087:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851215.461468:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019780736 00000100:00100000:0.0:1788851215.461478:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019780736 00000100:00100000:0.0:1788851215.461529:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851215.461547:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019780736:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788851215.461631:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019780736:12345-0@lo:38:llog_process_th.0 Request processed in 85us (545us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788851215.461639:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851215.461951:0:17245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17245:1875746019780864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851215.461996:0:17245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851215.462039:0:17245:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d85ed0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788851215.462319:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851215.462338:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5569800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851215.462342:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788851215.462346:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019780736:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788851215.463807:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019780864 00000100:00100000:0.0:1788851215.463822:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019780864 00000100:00100000:0.0:1788851215.463874:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788851215.463883:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17245:x1875746019780864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851215.464075:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17245:x1875746019780864:12345-0@lo:502:llog_process_th.0 Request processed in 192us (2077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851215.464085:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788851215.464148:0:17245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17245:1875746019780864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851215.464293:0:17245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c37480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17245:1875746019780992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851215.464332:0:17245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851215.464358:0:17245:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86993000 going to sleep for 11 seconds 00000100:00100000:0.0:1788851215.464371:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019780992 00000100:00100000:0.0:1788851215.464375:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019780992 00000100:00100000:0.0:1788851215.464395:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788851215.464408:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+12:17245:x1875746019780992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851215.464466:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+12:17245:x1875746019780992:12345-0@lo:502:llog_process_th.0 Request processed in 58us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851215.464473:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788851215.464503:0:17245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c37480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a8a82bd-f416-4736-bb65-b562856c988b:17245:1875746019780992:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788851215.464520:0:17245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788851215.464880:0:17191:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788851215.464911:0:17191:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788851215.464937:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.464950:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788851215.465026:0:17191:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788851215.465029:0:17191:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788851215.465031:0:17191:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851215.465032:0:17191:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851215.465034:0:17191:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851215.465035:0:17191:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851215.465036:0:17191:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788851215.465038:0:17191:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788851215.465040:0:17191:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851215.465041:0:17191:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851215.465045:0:17191:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788851215.465047:0:17191:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788851215.465049:0:17191:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788851215.465050:0:17191:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851215.465051:0:17191:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851215.465052:0:17191:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851215.465053:0:17191:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851215.465054:0:17191:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788851215.465055:0:17191:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788851215.465062:0:17191:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851215.465063:0:17191:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851215.465084:0:17191:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788851215.465097:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019781120:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788851215.465135:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851215.473401:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019781120 00000100:00100000:0.0:1788851215.473419:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019781120 00000100:00100000:0.0:1788851215.473491:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788851215.473502:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:17191:x1875746019781120:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788851215.474146:0:17205:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788851215.474235:0:17205:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788851215.477527:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d85ed0600 going to sleep for 11 seconds 20000000:01000000:0.0:1788851215.481070:0:17205:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788851215.481092:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788851215.481308:0:17228:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788851215.481314:0:17228:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788851215.481340:0:17228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.481357:0:17228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206acb expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.481364:0:17228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.481407:0:17228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206acb expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.481423:0:17228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206acb expref: 12 pid: 17207 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851215.481439:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019781248:0@lo:104: 00000100:00100000:3.0:1788851215.481507:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851215.481566:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d85ed0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788851215.481658:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019781248 00000100:00100000:1.0:1788851215.481668:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019781248 00000100:00100000:1.0:1788851215.481725:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788851215.481735:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:17228:x1875746019781248:12345-0@lo:104: 00000100:00100000:0.0:1788851215.481735:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:17191:x1875746019781120:12345-0@lo:253:mount.lustre.0 Request processed in 8235us (16598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851215.481745:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788851215.481749:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.481797:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788851215.481803:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:17228:x1875746019781248:12345-0@lo:104: Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851215.481810:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788851215.481827:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851215.481833:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.481851:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851215.481856:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.481865:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851215.481872:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851215.481890:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788851215.481925:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.481931:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851215.481958:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.481966:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892d876e7600/0x3e0030720b206acb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206ad2 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.481983:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851215.481985:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851215.481986:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851215.482058:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019781376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851215.482090:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.482136:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019781376 00000100:00100000:1.0:1788851215.482140:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019781376 00010000:00010000:1.0:1788851215.482157:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206acb expref: 12 pid: 17207 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.482184:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788851215.482190:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+12:3648:x1875746019781376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851215.482201:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851215.482207:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206acb expref: 12 pid: 17207 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482218:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206acb expref: 12 pid: 17207 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482240:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482248:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788851215.482262:0:17197:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000949571s 00010000:00010000:1.0:1788851215.482267:0:17197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482275:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482282:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482288:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482293:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851215.482297:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482305:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482313:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482323:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851215.482359:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+12:3648:x1875746019781376:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851215.482371:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788851215.482412:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80030400/0x3e0030720b206ad2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206acb expref: 11 pid: 17207 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.482423:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019781248:0@lo:104: 00010000:00010000:1.0:1788851215.482443:0:17228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482453:0:17228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482459:0:17228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.482465:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e8a8b9c00/0x3e0030720b206b03 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.482497:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17191:1875746019781120:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788851215.482511:0:17191:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788851215.482515:0:17191:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788851215.482517:0:17191:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788851215.482519:0:17191:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851215.482520:0:17191:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851215.482521:0:17191:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851215.482523:0:17191:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851215.482524:0:17191:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788851215.482526:0:17191:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788851215.482528:0:17191:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851215.482529:0:17191:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788851215.482546:0:17191:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788851215.482639:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019781376:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788851215.508172:0:17191:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788851215.508964:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788851215.509061:0:17251:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788851215.509067:0:17251:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788851215.512095:0:17252:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788851215.512147:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788851215.513939:0:17252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788851215.514624:0:17253:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff892ea5994380 x1875746019781504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851215.514636:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00000040:01000000:1.0:1788851215.515073:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788851215.515116:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788851215.517892:0:17191:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788851215.517920:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788851215.518041:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851215.520821:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788851215.521629:0:17252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788851215.521695:0:17252:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788851215.522486:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788851215.523110:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788851215.525876:0:17191:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788851215.530457:0:17191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788851215.532956:0:17191:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788851215.532998:0:17191:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa99041bbf988 00100000:10000000:1.0:1788851215.533157:0:17191:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788851215.534231:0:17191:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788851215.534249:0:17191:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788851215.534268:0:17191:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788851215.534290:0:17191:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788851215.534936:0:17191:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851215.535176:0:17191:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788851216.180532:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851216.502036:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851216.566304:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 10000000:01000000:0.0:1788851216.948149:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851216.948158:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e84cde000 from 7 10000000:01000000:0.0:1788851216.948163:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851216.948211:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851216.948225:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851216.948246:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851216.948274:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019781632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851216.948363:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851216.948425:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e4e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788851216.948560:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019781632 00000100:00100000:2.0:1788851216.948569:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019781632 00000100:00100000:2.0:1788851216.948635:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851216.948644:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+11:17209:x1875746019781632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851216.948658:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851216.948673:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206b0a expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851216.948696:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206b0a expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851216.948707:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206b0a expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851216.948727:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6400, rc 0) 00000100:00100000:2.0:1788851216.948776:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17209:x1875746019781632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851216.948783:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788851216.949006:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019781632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851216.949044:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851216.949055:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851216.949110:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019781760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788851216.949146:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851216.949176:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95300 going to sleep for 11 seconds 00000100:00100000:0.0:1788851216.949216:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019781760 00000100:00100000:0.0:1788851216.949221:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019781760 00000100:00100000:0.0:1788851216.949287:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788851216.949295:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:17209:x1875746019781760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788851216.949309:0:17205:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788851216.949326:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788851216.949329:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788851216.949429:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:17209:x1875746019781760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851216.949437:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851216.949609:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019781760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788851216.949648:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788851216.949654:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851216.949663:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.211879:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851217.527338:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851217.588200:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00010000:00010000:0.0:1788851218.228187:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851218.612179:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00010000:00010000:3.0:1788851219.254759:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851219.639957:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00000001:02000400:2.0:1788851219.681512:0:17495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788851220.281088:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851220.660770:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00000020:00000004:1.0:1788851220.683725:0:17547:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851220.684954:0:17547:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1788851220.918167:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788851220.918175:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788851220.918178:0:8:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851220.918186:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:0.0:1788851220.918192:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788851220.918203:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892ea576a000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851220.918228:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c35f80 x1875746019782016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851220.919931:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851220.919945:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851220.919948:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851220.919951:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851220.919953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788851220.919957:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788851220.919960:0:8:0:(import.c:65:import_set_state_nolock()) ffff892ea5569800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851220.919973:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff892ea5569800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851220.920002:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c34000 x1875746019782144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851220.921169:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019781888:0@lo:400:kworker.0 00000100:00100000:1.0:1788851220.921291:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851220.921418:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019782016:0@lo:38:kworker.0 00000100:00100000:0.0:1788851220.921659:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851220.921685:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019782144:0@lo:38:kworker.0 00000100:00100000:0.0:1788851220.921711:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851220.921747:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019781888 00000100:00100000:0.0:1788851220.921755:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019781888 00000100:00100000:0.0:1788851220.922356:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788851220.922368:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+12:3649:x1875746019781888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851220.923048:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+12:3649:x1875746019781888:12345-0@lo:400:kworker.0 Request processed in 680us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851220.923058:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788851220.923063:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019781888:0@lo:400:kworker.0 00000100:00100000:0.0:1788851220.924448:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019782144 00000100:00100000:0.0:1788851220.924460:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019782144 00000100:00100000:0.0:1788851220.924505:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851220.924513:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019782144:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788851220.924556:0:17214:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:0.0:1788851220.924594:0:17214:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e0030720b206b18 00000004:00100000:0.0:1788851220.924610:0:17214:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788851220.924745:0:17214:0:(import.c:65:import_set_state_nolock()) ffff892ea556f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851220.924844:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875746019782144:12345-0@lo:38:kworker.0 Request processed in 330us (3130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851220.924850:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851220.924885:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019782016 00000100:00100000:0.0:1788851220.924889:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019782016 00000100:00100000:0.0:1788851220.924911:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851220.924916:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875746019782016:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788851220.924928:0:17218:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788851220.926490:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892e87c34000 x1875746019782144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788851220.926537:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788851220.926549:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788851220.926567:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788851220.926571:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5569800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788851220.926580:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019782144:0@lo:38:kworker.0 00000100:00100000:0.0:1788851220.940930:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875746019782016:12345-0@lo:38:kworker.0 Request processed in 16005us (19263us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788851220.940947:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788851220.940982:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851220.940988:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788851220.940992:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019782016:0@lo:38:kworker.0 00010000:00010000:1.0:1788851221.301744:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788851221.558757:0:17598:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851221.558983:0:17598:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788851221.689249:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00010000:00010000:3.0:1788851222.329824:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851222.709430:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00010000:00010000:3.0:1788851223.352184:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851223.733082:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00010000:00010000:3.0:1788851224.372262:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851224.756151:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00000100:00100000:1.0:1788851225.013162:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851215/real 1788851215] req@ffff892ea5996d80 x1875746019779072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851225.013194:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea5996d80 x1875746019779072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851225.013202:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851215/real 1788851215] req@ffff892ea5994700 x1875746019778944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851225.013213:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea5994700 x1875746019778944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788851225.013230:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851225.013246:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851225.013251:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019779072:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788851225.013256:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5769000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851225.013261:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851225.013264:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019778944:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788851225.013450:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788851225.013455:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788851225.013457:0:37:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851225.013462:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 554 00000100:00080000:1.0:1788851225.013468:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788851225.013479:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892ea576a000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851225.013500:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad4e00 x1875746019782400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851225.013515:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851225.013518:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788851225.013519:0:37:0:(import.c:65:import_set_state_nolock()) ffff892ea5769000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851225.013523:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:1.0:1788851225.013525:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788851225.013529:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff892ea5769000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851225.013540:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad5500 x1875746019782528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851225.013547:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851225.013550:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788851225.013552:0:37:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851225.013555:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:1.0:1788851225.013558:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788851225.013561:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892e88540000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851225.013572:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad5f80 x1875746019782656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851225.013630:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851225.013641:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019782272:0@lo:400:kworker.0 00000100:00100000:1.0:1788851225.013704:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851225.013755:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019782400:0@lo:38:kworker.0 00000100:00100000:1.0:1788851225.013783:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851225.013802:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019782528:0@lo:8:kworker.0 00000400:00000100:1.0:1788851225.013844:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019782528 offset 0 length 520: 4 00000100:00100000:1.0:1788851225.013857:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019782656:0@lo:8:kworker.0 00000400:00000100:1.0:1788851225.013873:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019782656 offset 0 length 520: 4 00000100:00100000:0.0:1788851225.015717:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851225.015741:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019782784:0@lo:400:kworker.0 00000100:00100000:0.0:1788851225.015817:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851225.015878:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019782272 00000100:00100000:0.0:1788851225.015887:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019782272 00000100:00100000:0.0:1788851225.015940:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788851225.015950:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:3649:x1875746019782272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851225.016006:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:3649:x1875746019782272:12345-0@lo:400:kworker.0 Request processed in 58us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851225.016035:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788851225.016089:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019782272:0@lo:400:kworker.0 00000100:00100000:1.0:1788851225.019247:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019782784 00000100:00100000:1.0:1788851225.019259:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019782784 00000100:00100000:1.0:1788851225.019320:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788851225.019330:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019782784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851225.019445:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019782784:12345-0@lo:400:kworker.0 Request processed in 117us (3628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851225.019453:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788851225.019513:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892ea5ad6680 x1875746019782784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851225.019530:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019782784:0@lo:400:kworker.0 00000100:00100000:2.0:1788851225.021103:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019782400 00000100:00100000:2.0:1788851225.021125:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019782400 00000100:00100000:2.0:1788851225.021180:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851225.021188:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019782400:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788851225.021210:0:17217:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851225.049534:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019782400:12345-0@lo:38:kworker.0 Request processed in 28332us (35735us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851225.049554:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788851225.049775:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851225.049782:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788851225.049786:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019782400:0@lo:38:kworker.0 00010000:00010000:3.0:1788851225.396254:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851225.780735:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00010000:00010000:3.0:1788851226.423721:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851226.805089:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00010000:00010000:3.0:1788851227.449031:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851227.765716:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851227.830263:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00000020:01000004:0.0:1788851228.148888:0:17943:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788851228.148892:0:17943:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788851228.148894:0:17943:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788851228.150100:0:17943:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892eb6cf0800 00000020:01000004:0.0:1788851228.150117:0:17943:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788851228.150131:0:17943:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788851228.150145:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff892ebbbc99c0) 00000020:00000080:0.0:1788851228.150162:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788851228.194196:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788851228.195187:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.199039:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788851228.199430:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788851228.199864:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788851228.200102:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788851228.200344:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788851228.200597:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788851228.200795:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788851228.201134:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788851228.201410:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788851228.201637:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788851228.201864:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788851228.202113:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788851228.204172:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.205001:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.205771:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.206216:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.206674:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.206913:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.207163:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.207399:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.207641:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.207916:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.208186:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.208404:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.208815:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.209006:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.209248:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.209515:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.209763:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.209937:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.210204:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.210425:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.210670:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.210867:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.211122:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.211659:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.211859:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.212129:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.212377:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.212649:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788851228.212834:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.213724:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.214000:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788851228.214258:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00080000:01000000:2.0:1788851228.215188:0:17943:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788851228.215439:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788851228.215451:0:17943:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788851228.215462:0:17943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b206b26 00000020:01000004:2.0:1788851228.215468:0:17943:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788851228.215489:0:17943:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788851228.215493:0:17943:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788851228.215499:0:17943:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788851228.215524:0:17943:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788851228.215527:0:17943:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788851228.221756:0:17943:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788851228.221800:0:17943:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788851228.221805:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788851228.221807:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788851228.221808:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851228.221810:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851228.221811:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851228.221812:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851228.221814:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788851228.221816:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851228.221817:0:17943:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788851228.221821:0:17943:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788851228.221823:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788851228.221825:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788851228.221826:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851228.221827:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851228.221829:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851228.221830:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851228.221831:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788851228.221832:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851228.221833:0:17943:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788851228.221858:0:17943:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788851228.221879:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019782912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788851228.221970:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.222070:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89afba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851228.222324:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019782912 00000100:00100000:0.0:1788851228.222334:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019782912 00000100:00100000:0.0:1788851228.222417:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788851228.222427:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17943:x1875746019782912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788851228.222463:0:17207:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788851228.222466:0:17207:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788851228.222475:0:17207:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788851228.222929:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+12:17943:x1875746019782912:12345-0@lo:253:mount.lustre.0 Request processed in 502us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851228.222939:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788851228.223091:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019782912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788851228.223115:0:17943:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788851228.223118:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788851228.223119:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788851228.223120:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851228.223121:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851228.223123:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851228.223124:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851228.223125:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788851228.223127:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851228.223128:0:17943:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788851228.223145:0:17943:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892eb6cf0800 from lustre-MDT0001 10000000:01000000:3.0:1788851228.223169:0:17943:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788851228.223172:0:17943:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788851228.223179:0:17943:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff892d85f23380 local copy 00010000:00010000:3.0:1788851228.223189:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851228.223727:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851228.223767:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.223850:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851228.228185:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019783040 00000100:00100000:0.0:1788851228.228199:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019783040 00000100:00100000:0.0:1788851228.228332:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788851228.228360:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+12:17943:x1875746019783040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851228.228525:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+12:17943:x1875746019783040:12345-0@lo:501:mount.lustre.0 Request processed in 184us (4757us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788851228.228535:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788851228.228679:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783040:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788851228.228701:0:17943:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788851228.228740:0:17943:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788851228.228749:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.228761:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851228.228795:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892eb6cf0800 10000000:01000000:3.0:1788851228.228806:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788851228.228812:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff892d85f23380 10000000:01000000:3.0:1788851228.228815:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788851228.228819:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff892d85f23380 from 1 10000000:01000000:3.0:1788851228.228822:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788851228.228853:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.228863:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.228873:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851228.228894:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851228.228928:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.230132:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851228.230182:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019783168 00000100:00100000:1.0:1788851228.230203:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019783168 00000100:00100000:1.0:1788851228.230245:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788851228.230253:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+12:17943:x1875746019783168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851228.230266:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851228.230402:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031400/0x3e0030720b206b34 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206b2d expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.230430:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031400/0x3e0030720b206b34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206b2d expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.230442:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031400/0x3e0030720b206b34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206b2d expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.230451:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031400, rc 0) 00000100:00100000:1.0:1788851228.230504:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+13:17943:x1875746019783168:12345-0@lo:101:mount.lustre.0 Request processed in 252us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851228.230511:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788851228.230611:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851228.230627:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b34 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.230637:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206b34 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851228.230653:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788851228.230672:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b34 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.230681:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b34 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851228.230702:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff892eb6cf0800 10000000:01000000:3.0:1788851228.230706:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788851228.230711:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff892eb6cf0800 from 1 10000000:01000000:3.0:1788851228.230713:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788851228.230735:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.230743:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.230752:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851228.230768:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851228.230796:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.230809:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.230870:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019783296 00000100:00100000:2.0:1788851228.230875:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019783296 00000100:00100000:2.0:1788851228.230897:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788851228.230903:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+13:17943:x1875746019783296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851228.230910:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851228.230919:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e7800/0x3e0030720b206b42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206b3b expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.230945:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e7800/0x3e0030720b206b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206b3b expref: 14 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.230954:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e7800/0x3e0030720b206b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206b3b expref: 14 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.230962:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7800, rc 0) 00000100:00100000:2.0:1788851228.230996:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+14:17943:x1875746019783296:12345-0@lo:101:mount.lustre.0 Request processed in 92us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.231003:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788851228.231299:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851228.231311:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.231319:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851228.231331:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788851228.231362:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.231370:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851228.231384:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788851228.231388:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788851228.231394:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff892eb6cf0800 10000000:01000000:3.0:1788851228.231396:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788851228.231400:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788851228.231402:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788851228.231417:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.231424:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.231432:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851228.231445:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851228.231471:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.231500:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.231830:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019783424 00000100:00100000:2.0:1788851228.231836:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019783424 00000100:00100000:2.0:1788851228.231871:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788851228.231880:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+14:17943:x1875746019783424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851228.231889:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851228.231901:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e7200/0x3e0030720b206b50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206b49 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.231916:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e7200/0x3e0030720b206b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206b49 expref: 15 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.231926:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e7200/0x3e0030720b206b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206b49 expref: 15 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.231933:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7200, rc 0) 00000100:00100000:2.0:1788851228.231973:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019783424:12345-0@lo:101:mount.lustre.0 Request processed in 94us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.231980:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788851228.232124:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851228.232136:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.232145:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851228.233956:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788851228.234886:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851228.246519:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788851228.246579:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788851228.246594:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788851228.246607:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788851228.246620:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788851228.246632:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788851228.246645:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788851228.246657:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788851228.246668:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788851228.246681:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788851228.246693:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788851228.246705:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788851228.246718:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788851228.246731:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788851228.246742:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788851228.246755:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788851228.246768:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788851228.246780:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788851228.246792:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788851228.246805:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788851228.246818:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788851228.246830:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788851228.246842:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788851228.246866:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788851228.246872:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788851228.246980:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851228.247068:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.247112:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.248970:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019783552 00000100:00100000:2.0:1788851228.248984:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019783552 00000100:00100000:2.0:1788851228.249080:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788851228.249090:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019783552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851228.249263:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019783552:12345-0@lo:501:mount.lustre.0 Request processed in 174us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.249271:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788851228.249704:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851228.249754:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851228.249809:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.249856:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788851228.249962:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019783680 00000100:00100000:1.0:1788851228.249968:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019783680 00000100:00100000:1.0:1788851228.250004:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788851228.250038:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019783680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851228.252330:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019783680:12345-0@lo:503:mount.lustre.0 Request processed in 2310us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851228.252344:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788851228.252630:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783680:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788851228.253100:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788851228.253177:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851228.253230:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.253256:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851228.253517:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019783808 00000100:00100000:0.0:1788851228.253524:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019783808 00000100:00100000:0.0:1788851228.253570:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788851228.253586:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019783808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851228.254265:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019783808:12345-0@lo:502:mount.lustre.0 Request processed in 678us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851228.254274:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788851228.254425:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851228.254633:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788851228.254660:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788851228.254673:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788851228.254686:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788851228.254698:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788851228.254710:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788851228.254722:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788851228.254735:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788851228.254747:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788851228.254758:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788851228.254771:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788851228.254783:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788851228.254798:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788851228.254811:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788851228.254824:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788851228.254836:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788851228.254848:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788851228.254860:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788851228.254871:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788851228.254885:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788851228.254898:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788851228.254910:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788851228.254932:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788851228.254946:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788851228.254958:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788851228.254969:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788851228.254982:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788851228.254994:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788851228.255006:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788851228.255058:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788851228.255072:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788851228.255084:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788851228.255096:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788851228.255108:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788851228.255121:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788851228.255133:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788851228.255145:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788851228.255157:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788851228.255170:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788851228.255181:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788851228.255194:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788851228.255207:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788851228.255219:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788851228.255231:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788851228.255264:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851228.255396:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851228.255491:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87bee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851228.260474:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019783936 00000100:00100000:1.0:1788851228.260489:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019783936 00000100:00100000:1.0:1788851228.260608:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788851228.260618:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019783936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851228.260803:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019783936:12345-0@lo:502:mount.lustre.0 Request processed in 186us (5406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851228.260812:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788851228.260903:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019783936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851228.260993:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788851228.261007:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788851228.262325:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851228.262347:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851228.262350:0:17947:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788851228.262366:0:17947:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788851228.262369:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788851228.262384:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff892ead6dcd40) 00000020:00000080:3.0:1788851228.262405:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788851228.262410:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788851228.262476:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788851228.262483:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b206b5e 00000020:00000080:3.0:1788851228.262677:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788851228.262681:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851228.262684:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851228.262686:0:17947:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788851228.262688:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851228.262692:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851228.262693:0:17947:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788851228.262696:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788851228.262703:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff892ead6d8000) 00000020:00000080:3.0:1788851228.262713:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788851228.262716:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788851228.262729:0:17947:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788851228.262732:0:17947:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788851228.262738:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788851228.262794:0:17947:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892eb6cf0800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788851228.262807:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff892ead6d99c0) 00000020:00000080:3.0:1788851228.262816:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788851228.262876:0:17947:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788851228.262885:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b206b73 00000020:00000080:3.0:1788851228.262972:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788851228.262978:0:17947:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788851228.262982:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x3e0030720b206b7a 00080000:01000000:3.0:1788851228.262988:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788851228.262991:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b206b81 00010000:00010000:0.0:1788851228.326965:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788851228.328612:0:17947:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788851228.330001:0:17947:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788851228.331227:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788851228.331242:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851228.331249:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.331252:0:17947:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788851228.331255:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851228.331260:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.331262:0:17947:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788851228.331265:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788851228.331271:0:17947:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:1.0:1788851228.331307:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788851228.331323:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff892eb6f419c0) 00000020:00000080:1.0:1788851228.331344:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788851228.331349:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788851228.331424:0:17947:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788851228.331430:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788851228.331437:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b206b8f 00010000:00080000:1.0:1788851228.331467:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892e88fa7000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1788851228.337809:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788851228.341447:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788851228.341469:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788851228.341596:0:17947:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788851228.341623:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b206b96 00000100:00080000:3.0:1788851228.341636:0:17947:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788851228.341648:0:17947:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff892e88fa7000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851228.341681:0:17947:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5996300 x1875746019784064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851228.341749:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019784064:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788851228.341873:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788851228.342063:0:17947:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788851228.342072:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019784064 00000100:00100000:2.0:1788851228.342079:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019784064 00000100:00100000:2.0:1788851228.342110:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788851228.342117:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875746019784064:12345-0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788851228.342125:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851228.342129:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851228.342131:0:17947:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788851228.342134:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788851228.342136:0:17947:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788851228.342138:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00010000:00080000:2.0:1788851228.342138:0:17218:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:01000000:3.0:1788851228.342139:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788851228.342141:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788851228.342143:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851228.342144:0:17947:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788851228.342152:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851228.342156:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851228.342158:0:17947:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788851228.342161:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:00000080:2.0:1788851228.342167:0:17218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b206b9d 00000004:00100000:2.0:1788851228.342185:0:17218:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788851228.342191:0:17218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:01000000:3.0:1788851228.342194:0:17947:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788851228.342220:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851228.342223:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851228.342224:0:17947:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788851228.342227:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788851228.342228:0:17947:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788851228.342229:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788851228.342231:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788851228.342232:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788851228.342234:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851228.342236:0:17947:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788851228.342239:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788851228.342242:0:17947:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788851228.342245:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851228.342247:0:17947:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788851228.342250:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788851228.342253:0:17947:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1788851228.342273:0:17947:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788851228.342275:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788851228.342297:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff892ead6db380) 00000020:00000080:3.0:1788851228.342312:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788851228.342317:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788851228.342405:0:17947:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788851228.342412:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788851228.342417:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b206bab 00000100:00080000:0.0:1788851228.342431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788851228.342437:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788851228.342440:0:36:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851228.342445:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:0.0:1788851228.342449:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00010000:00080000:3.0:1788851228.342454:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892eab226800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.127@tcp at head 00000100:00080000:0.0:1788851228.342454:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892ea576a000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851228.342472:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c36680 x1875746019784192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788851228.343797:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1788851228.347450:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851228.347461:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851228.347464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851228.347468:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788851228.347543:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019784320:0@lo:400:kworker.0 00000100:00100000:0.0:1788851228.347626:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851228.347687:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019784320 00000100:00100000:0.0:1788851228.347695:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019784320 00000100:00100000:0.0:1788851228.347744:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851228.347754:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019784320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851228.347831:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019784320:12345-0@lo:400:kworker.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851228.347840:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788851228.347886:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892e87c34380 x1875746019784320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851228.347900:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019784320:0@lo:400:kworker.0 00000040:01000000:3.0:1788851228.348173:0:17947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:3.0:1788851228.348852:0:17218:0:(import.c:65:import_set_state_nolock()) ffff892eab221800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851228.348926:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875746019784064:12345-0@lo:38:llog_process_th.0 Request processed in 6806us (7058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851228.348936:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:01000000:3.0:1788851228.349557:0:17947:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788851228.352651:0:17947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851228.353258:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788851228.353407:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1788851228.353572:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019784192:0@lo:38:kworker.0 00000100:00100000:1.0:1788851228.353645:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.353701:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851228.353712:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788851228.353728:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788851228.353733:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788851228.353737:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88fa7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788851228.353748:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019784064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788851228.354122:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019784192 00000100:00100000:3.0:1788851228.354131:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019784192 00000100:00100000:3.0:1788851228.354171:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851228.354178:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019784192:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788851228.354236:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019784192:12345-0@lo:38:kworker.0 Request processed in 57us (591us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788851228.354242:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788851228.354397:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019784448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851228.354425:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.354463:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851228.354467:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851228.354471:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788851228.354474:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019784192:0@lo:38:kworker.0 00000100:00100000:3.0:1788851228.354527:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019784448 00000100:00100000:3.0:1788851228.354531:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019784448 00000100:00100000:3.0:1788851228.354564:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851228.354569:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1875746019784448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851228.354596:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788851228.354644:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1875746019784448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851228.354649:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788851228.354710:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019784448:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788851228.358136:0:17952:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788851228.358143:0:17952:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788851228.361466:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788851228.361484:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788851228.361533:0:17947:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788851228.361557:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b206bb2 00000100:00080000:0.0:1788851228.361569:0:17947:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851228.361581:0:17947:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff892eab226800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851228.361624:0:17947:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c34380 x1875746019784576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851228.361644:0:17947:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788851228.361713:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851228.361718:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851228.361720:0:17947:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788851228.361723:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788851228.361726:0:17947:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788851228.361728:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851228.361729:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851228.361731:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788851228.361733:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851228.361735:0:17947:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788851228.361737:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788851228.361741:0:17947:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788851228.361745:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851228.361756:0:17947:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788851228.361761:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788851228.361764:0:17947:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000100:00080000:2.0:1788851228.361776:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851228.361780:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851228.361783:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851228.361786:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788851228.361788:0:17947:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788851228.361790:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851228.361801:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff892ebbbccd40) 00000020:00000080:0.0:1788851228.361814:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788851228.361821:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788851228.361899:0:17947:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788851228.361907:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788851228.361912:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b206bc0 00010000:00080000:0.0:1788851228.361940:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892ea4358800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788851228.362155:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788851228.362224:0:17947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788851228.362239:0:17947:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788851228.362456:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019784576:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788851228.362508:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019784576 offset 0 length 520: 4 00000040:00080000:2.0:1788851228.367090:0:17947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851228.367403:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788851228.367528:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788851228.369996:0:17954:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788851228.370003:0:17954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788851228.371536:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788851228.371553:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788851228.371598:0:17947:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788851228.371623:0:17947:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b206bc7 00000100:00080000:2.0:1788851228.371633:0:17947:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788851228.371645:0:17947:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892ea4358800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851228.371683:0:17947:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c37800 x1875746019784704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851228.371763:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019784704:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788851228.371806:0:17947:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000400:00000100:1.0:1788851228.371838:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019784704 offset 0 length 520: 4 00000020:01000000:2.0:1788851228.371992:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851228.371996:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851228.371998:0:17947:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788851228.372002:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851228.372006:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851228.372041:0:17947:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788851228.372046:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788851228.372048:0:17947:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788851228.372051:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851228.372053:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851228.372055:0:17947:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788851228.372057:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851228.372060:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851228.372061:0:17947:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788851228.372065:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788851228.372098:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851228.372101:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851228.372103:0:17947:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788851228.372106:0:17947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1788851228.372217:0:17943:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788851228.372249:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788851228.372271:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.372284:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851228.372293:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892eb6cf0800 from 1 10000000:01000000:1.0:1788851228.372303:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788851228.372333:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.372342:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.372365:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851228.372383:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019784832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851228.372426:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.372445:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64a80 going to sleep for 11 seconds 00000100:00080000:3.0:1788851228.372502:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788851228.372510:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019784832 00000100:00100000:0.0:1788851228.372517:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019784832 00000100:00100000:0.0:1788851228.372572:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788851228.372581:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+15:17943:x1875746019784832:12345-0@lo:101:mount.lustre.0 00000100:00080000:3.0:1788851228.372583:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788851228.372586:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851228.372589:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788851228.372594:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851228.372609:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206bce expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851228.372635:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206bce expref: 16 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851228.372646:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206bce expref: 16 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851228.372655:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bda00, rc 0) 00000100:00100000:0.0:1788851228.372741:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+16:17943:x1875746019784832:12345-0@lo:101:mount.lustre.0 Request processed in 161us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851228.372747:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019784832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851228.372749:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788851228.372761:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.372769:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851228.373329:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019784960:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788851228.373381:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.373413:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851228.373478:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019784960 00000100:00100000:0.0:1788851228.373483:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019784960 00000100:00100000:0.0:1788851228.373560:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788851228.373569:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+16:17943:x1875746019784960:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788851228.373583:0:17206:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788851228.373602:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788851228.373605:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788851228.373689:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+16:17943:x1875746019784960:12345-0@lo:256:mount.lustre.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851228.373695:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788851228.373763:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019784960:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788851228.374337:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788851228.374376:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.374399:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851228.374407:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892eb6cf0800 from 1 10000000:01000000:1.0:1788851228.374409:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851228.374439:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.374445:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.374453:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851228.374468:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851228.374501:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.374764:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.374820:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019785088 00000100:00100000:2.0:1788851228.374825:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019785088 00000100:00100000:2.0:1788851228.374855:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788851228.374863:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+16:17943:x1875746019785088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851228.374873:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851228.374886:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206bdc expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.374906:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206bdc expref: 17 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.374915:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206bdc expref: 17 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.374923:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6000, rc 0) 00000100:00100000:2.0:1788851228.374966:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785088:12345-0@lo:101:mount.lustre.0 Request processed in 103us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.374972:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788851228.375065:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851228.375076:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.375084:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851228.375195:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788851228.375221:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851228.375249:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.375280:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c643c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.375327:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019785216 00000100:00100000:2.0:1788851228.375332:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019785216 00000100:00100000:2.0:1788851228.375348:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788851228.375365:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851228.375445:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785216:12345-0@lo:501:mount.lustre.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.375451:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851228.375505:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851228.375530:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851228.375566:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.375584:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c643c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.375624:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019785344 00000100:00100000:2.0:1788851228.375628:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019785344 00000100:00100000:2.0:1788851228.375643:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788851228.375648:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785344:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851228.375715:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785344:12345-0@lo:503:mount.lustre.0 Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.375721:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851228.375791:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785344:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788851228.376216:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788851228.376279:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851228.376317:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.376334:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851228.376425:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019785472 00000100:00100000:3.0:1788851228.376430:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019785472 00000100:00100000:3.0:1788851228.376453:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788851228.376461:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851228.376558:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785472:12345-0@lo:502:mount.lustre.0 Request processed in 97us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851228.376565:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788851228.376640:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788851228.376830:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788851228.376856:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788851228.376870:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788851228.376883:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788851228.376896:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788851228.376911:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788851228.376921:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788851228.376932:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788851228.376943:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788851228.376953:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788851228.376965:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788851228.376983:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851228.377051:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.377072:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851228.377293:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019785600 00000100:00100000:3.0:1788851228.377298:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019785600 00000100:00100000:3.0:1788851228.377321:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788851228.377326:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851228.377414:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785600:12345-0@lo:502:mount.lustre.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851228.377421:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788851228.377495:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788851228.377533:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788851228.377548:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788851228.378153:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851228.378162:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.378164:0:17956:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788851228.378173:0:17956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892eb6cf0800 00000020:00000080:1.0:1788851228.378176:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851228.378183:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851228.378185:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.378186:0:17956:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788851228.378189:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851228.378191:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.378192:0:17956:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788851228.378196:0:17956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892eb6cf0800 00000020:00000080:1.0:1788851228.378198:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851228.378249:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851228.378253:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.378254:0:17956:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788851228.378256:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851228.378258:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.378260:0:17956:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851228.378263:0:17956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892eb6cf0800 00000020:00000080:1.0:1788851228.378265:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851228.378282:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851228.378285:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.378287:0:17956:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851228.378289:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851228.378292:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.378293:0:17956:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788851228.378297:0:17956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892eb6cf0800 00000020:00000080:1.0:1788851228.378298:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851228.378318:0:17956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851228.378321:0:17956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851228.378322:0:17956:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788851228.378325:0:17956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788851228.384072:0:17943:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788851228.384138:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788851228.384161:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.384178:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851228.384264:0:17943:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788851228.384267:0:17943:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892eb6cf0800 10000000:01000000:3.0:1788851228.384272:0:17943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892eb6cf0800 10000000:01000000:3.0:1788851228.384277:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788851228.384283:0:17943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892eb6cf0800 from 1 10000000:01000000:3.0:1788851228.384287:0:17943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788851228.384342:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.384361:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.384374:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851228.384403:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851228.384483:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.384528:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019785728 00000100:00100000:3.0:1788851228.384536:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019785728 00000100:00100000:3.0:1788851228.384587:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788851228.384597:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+17:17943:x1875746019785728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851228.384612:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851228.384625:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e8a8b9a00/0x3e0030720b206bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206bea expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.384654:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e8a8b9a00/0x3e0030720b206bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206bea expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.384664:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e8a8b9a00/0x3e0030720b206bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206bea expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.384672:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9a00, rc 0) 00000100:00100000:3.0:1788851228.384703:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019785728:12345-0@lo:101:mount.lustre.0 Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851228.384710:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788851228.384762:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead29fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851228.384790:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851228.384805:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.384815:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851228.389433:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788851228.389724:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851228.389874:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788851228.389896:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788851228.389908:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788851228.389918:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788851228.389929:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788851228.389939:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788851228.389950:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788851228.389960:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788851228.389971:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788851228.389982:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788851228.389993:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788851228.390005:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788851228.390044:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788851228.390058:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788851228.390069:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788851228.390080:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788851228.390091:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788851228.390101:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788851228.390111:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788851228.390122:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788851228.390133:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788851228.390144:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788851228.390164:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788851228.390174:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788851228.390185:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788851228.390195:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788851228.390205:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788851228.390218:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788851228.390236:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788851228.390241:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788851228.390336:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851228.390411:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.390450:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8704e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788851228.392476:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019785856 00000100:00100000:1.0:1788851228.392489:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019785856 00000100:00100000:1.0:1788851228.392545:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788851228.392554:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019785856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851228.392705:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019785856:12345-0@lo:501:mount.lustre.0 Request processed in 152us (2294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851228.392713:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788851228.392797:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851228.392846:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851228.392888:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851228.392913:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019785984 00000100:00100000:2.0:1788851228.392917:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019785984 00000100:00100000:3.0:1788851228.392922:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8704e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.392950:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788851228.392957:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019785984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851228.393074:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019785984:12345-0@lo:503:mount.lustre.0 Request processed in 116us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.393081:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788851228.393090:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019785984:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788851228.394273:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788851228.394449:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019786112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851228.394508:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.394588:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443780 going to sleep for 11 seconds 00000100:00100000:1.0:1788851228.397494:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019786112 00000100:00100000:1.0:1788851228.397510:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019786112 00000100:00100000:1.0:1788851228.397560:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788851228.397571:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019786112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851228.397770:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019786112:12345-0@lo:502:mount.lustre.0 Request processed in 200us (3260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851228.397778:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788851228.401746:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019786112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851228.401985:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788851228.405081:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788851228.405116:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788851228.405128:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788851228.405138:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788851228.405149:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788851228.405167:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788851228.405178:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788851228.405189:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788851228.405199:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788851228.405210:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788851228.405221:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788851228.405231:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788851228.405242:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788851228.405269:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788851228.405284:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788851228.405296:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788851228.405308:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788851228.405319:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788851228.405331:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788851228.405344:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788851228.405371:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788851228.405383:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788851228.405395:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788851228.405407:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788851228.405419:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788851228.405433:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788851228.405446:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788851228.405457:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788851228.405469:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788851228.405496:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788851228.405512:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788851228.405525:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788851228.405539:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788851228.405551:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788851228.405562:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788851228.405574:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788851228.405586:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788851228.405598:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788851228.405622:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788851228.405635:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788851228.405647:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788851228.405659:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788851228.405671:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788851228.405684:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788851228.405697:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788851228.405723:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788851228.405740:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788851228.405796:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019786240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851228.405872:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.405921:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.405982:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019786240 00000100:00100000:2.0:1788851228.405990:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019786240 00000100:00100000:2.0:1788851228.406054:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788851228.406064:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019786240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851228.406182:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019786240:12345-0@lo:502:mount.lustre.0 Request processed in 120us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.406197:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788851228.406399:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019786240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851228.406564:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788851228.406587:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788851228.406608:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019786368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851228.406642:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.406670:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.406689:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019786368 00000100:00100000:2.0:1788851228.406694:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019786368 00000100:00100000:2.0:1788851228.406722:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788851228.406729:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019786368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851228.406788:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019786368:12345-0@lo:502:mount.lustre.0 Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.406794:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788851228.407361:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019786368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851228.407407:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788851228.407417:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788851228.407999:0:17962:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788851228.408130:0:17962:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff892eb6f44d40) 00000020:00000080:1.0:1788851228.408150:0:17962:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788851228.408239:0:17962:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892eb6cf0800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788851228.408243:0:17962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892eb6cf0800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788851228.408246:0:17962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892eb6cf0800 3 00010000:00080000:1.0:1788851228.408274:0:17962:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d85c52000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1788851228.410638:0:17962:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788851228.410842:0:17962:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788851228.410882:0:17962:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788851228.410893:0:17962:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x3e0030720b206bff 00000100:00080000:1.0:1788851228.410904:0:17962:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788851228.410914:0:17962:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff892d85c52000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851228.410949:0:17962:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5ad6d80 x1875746019786496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851228.410986:0:17962:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788851228.411039:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851228.411044:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851228.411046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851228.411050:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788851228.411064:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019786496:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788851228.411134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.411234:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019786496 00000100:00100000:1.0:1788851228.411242:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019786496 00000100:00100000:1.0:1788851228.411584:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851228.411592:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019786496:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788851228.411632:0:17214:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:1.0:1788851228.411664:0:17214:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3e0030720b206c06 00000004:00100000:1.0:1788851228.411681:0:17214:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788851228.411710:0:17214:0:(import.c:65:import_set_state_nolock()) ffff892d85c55800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851228.411773:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875746019786496:12345-0@lo:38:llog_process_th.0 Request processed in 180us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851228.411780:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788851228.412155:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892ea5ad6d80 x1875746019786496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851228.412165:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788851228.412175:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788851228.412182:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788851228.412187:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788851228.412189:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c52000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788851228.412196:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019786496:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788851228.412738:0:17962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788851228.412895:0:17943:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788851228.412925:0:17943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788851228.412941:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851228.412961:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788851228.413002:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788851228.413004:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788851228.413006:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851228.413007:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851228.413008:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851228.413031:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851228.413033:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788851228.413035:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851228.413036:0:17943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851228.413039:0:17943:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788851228.413042:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788851228.413043:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788851228.413044:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851228.413045:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851228.413046:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851228.413047:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851228.413048:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788851228.413049:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851228.413050:0:17943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851228.413070:0:17943:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788851228.413086:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019786624:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788851228.413140:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.413181:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea5443780 going to sleep for 11 seconds 00000100:00100000:0.0:1788851228.413285:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019786624 00000100:00100000:0.0:1788851228.413291:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019786624 00000100:00100000:0.0:1788851228.413334:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788851228.413341:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019786624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788851228.413385:0:17207:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788851228.413407:0:17207:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788851228.417492:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788851228.417935:0:17207:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788851228.417952:0:17207:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788851228.418188:0:17228:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788851228.418193:0:17228:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788851228.418217:0:17228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.418237:0:17228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206b0a expref: 18 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.418261:0:17228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206bce expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.418268:0:17228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.418313:0:17228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206bce expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.418327:0:17228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206bce expref: 18 pid: 17205 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851228.418344:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019786752:0@lo:104: 00000100:00100000:1.0:1788851228.418426:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788851228.418479:0:17228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206b0a expref: 18 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.418488:0:17228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206b0a expref: 18 pid: 17207 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851228.418495:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019786880:0@lo:104: 00000100:00100000:1.0:1788851228.418517:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851228.418537:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851228.418762:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019786752 00000100:00100000:2.0:1788851228.418771:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019786752 00000100:00100000:2.0:1788851228.418807:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019786880 00000100:00100000:2.0:1788851228.418810:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019786880 00000100:00100000:2.0:1788851228.418826:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851228.418836:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+4:17228:x1875746019786752:12345-0@lo:104: 00010000:00010000:2.0:1788851228.418849:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.418918:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788851228.418924:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+4:17228:x1875746019786752:12345-0@lo:104: Request processed in 90us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.418932:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851228.418948:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851228.418954:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:17228:x1875746019786880:12345-0@lo:104: 00010000:00010000:2.0:1788851228.418962:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851228.419369:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:17943:x1875746019786624:12345-0@lo:253:mount.lustre.0 Request processed in 6025us (6227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851228.419378:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788851228.419523:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019786752:0@lo:104: 00000100:00100000:1.0:1788851228.419533:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019786880:0@lo:104: 00010000:00010000:1.0:1788851228.419558:0:17228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.419616:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788851228.419622:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:17228:x1875746019786880:12345-0@lo:104: Request processed in 669us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.419629:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788851228.419646:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788851228.419652:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.419660:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788851228.419664:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.419674:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788851228.419682:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851228.419688:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788851228.419761:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.419769:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788851228.419795:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.419801:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206bce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206bd5 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.419822:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851228.419825:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.419830:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788851228.419833:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.419838:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788851228.419844:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851228.419849:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788851228.419885:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019787008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851228.419918:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851228.419950:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:17943:1875746019786624:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788851228.419961:0:17943:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788851228.419963:0:17943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788851228.419965:0:17943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788851228.419967:0:17943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851228.419968:0:17943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851228.419970:0:17943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1788851228.419972:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019787008 00000020:01000004:3.0:1788851228.419975:0:17943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851228.419976:0:17943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:1.0:1788851228.419977:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019787008 00000020:01000004:3.0:1788851228.419978:0:17943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851228.419979:0:17943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788851228.419990:0:17943:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788851228.419993:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206bce expref: 18 pid: 17205 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851228.420030:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788851228.420037:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+18:3650:x1875746019787008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851228.420047:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851228.420052:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206bce expref: 18 pid: 17205 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.420062:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206bce expref: 18 pid: 17205 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.420077:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea55bda00/0x3e0030720b206bd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206bce expref: 18 pid: 17205 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.420086:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851228.420111:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+17:3650:x1875746019787008:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851228.420117:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788851228.420160:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019787008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851228.420557:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420565:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788851228.420594:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420601:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea55bc800/0x3e0030720b206b0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206b11 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420613:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851228.420615:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851228.420616:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851228.420622:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851228.420688:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019787136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851228.420717:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851228.420795:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019787136 00000100:00100000:2.0:1788851228.420800:0:17199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019787136 00010000:00010000:2.0:1788851228.420816:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206b0a expref: 17 pid: 17207 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851228.420875:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851228.420883:0:17199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a8a82bd-f416-4736-bb65-b562856c988b+17:3647:x1875746019787136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851228.420891:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851228.420896:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206b0a expref: 17 pid: 17207 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420906:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206b0a expref: 17 pid: 17207 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420917:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6400/0x3e0030720b206b11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206b0a expref: 17 pid: 17207 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420928:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420937:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788851228.420951:0:17199:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002758525s 00010000:00010000:2.0:1788851228.420956:0:17199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420963:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420970:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420983:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.420989:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851228.420994:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.421001:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.421039:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851228.421050:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851228.421082:0:17199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a8a82bd-f416-4736-bb65-b562856c988b+16:3647:x1875746019787136:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851228.421089:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851228.421275:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019787136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851228.421322:0:17228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.421331:0:17228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851228.421338:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80030400/0x3e0030720b206c0d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1788851228.433648:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788851228.433716:0:17967:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788851228.433721:0:17967:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788851228.433938:0:17968:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788851228.433973:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788851228.434377:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875746019787264:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788851228.434458:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851228.434494:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebffad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851228.434523:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019787264 00000100:00100000:3.0:1788851228.434531:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019787264 00000100:00100000:3.0:1788851228.434578:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851228.434587:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875746019787264:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788851228.434616:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788851228.434654:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788851228.434662:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875746019787264:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851228.434670:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1788851228.434858:0:17968:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788851228.434881:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875746019787264:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788851228.434905:0:17969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788851228.434928:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875746019787392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788851228.434955:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851228.434973:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019787392 00000100:00100000:0.0:1788851228.434976:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019787392 00000100:00100000:0.0:1788851228.434995:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788851228.435000:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875746019787392:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788851228.435091:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875746019787392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851228.435098:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788851228.435114:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebffad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851228.435124:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875746019787392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788851228.435162:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17969:1875746019787520:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788851228.435183:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851228.435213:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019787520 00000100:00100000:0.0:1788851228.435216:0:17223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019787520 00000100:00100000:0.0:1788851228.435244:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851228.435249:0:17223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17969:x1875746019787520:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788851228.435277:0:17223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17969:x1875746019787520:12345-0@lo:900:lod0001_rec0000.0 Request processed in 28us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851228.435283:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851228.435297:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebffad540 going to sleep for 11 seconds 00010000:00080000:0.0:1788851228.435309:0:17969:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892e87c34000 x1875746019787520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788851244 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851228.435320:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17969:1875746019787520:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788851228.435359:0:17969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875746019787648:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788851228.435390:0:17969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851228.435405:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019787648 00000100:00100000:0.0:1788851228.435408:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019787648 00000100:00100000:0.0:1788851228.435424:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788851228.435429:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875746019787648:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788851228.435462:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17969:x1875746019787648:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 32us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851228.435468:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788851228.435481:0:17969:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebffad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851228.435489:0:17969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17969:1875746019787648:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788851228.435517:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851228.437490:0:17968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788851228.437568:0:17968:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1788851228.437753:0:17943:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788851228.437768:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788851228.437863:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851228.438788:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788851228.439361:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788851228.439391:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788851228.439558:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788851228.440232:0:17943:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:0.0:1788851228.440612:0:17969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788851228.440682:0:17969:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788851228.440686:0:17969:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1788851228.442138:0:17943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788851228.443545:0:17943:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788851228.443583:0:17943:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa99041c8b988 00100000:10000000:1.0:1788851228.443591:0:17943:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788851228.446078:0:17943:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788851228.446112:0:17943:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788851228.446141:0:17943:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788851228.446160:0:17943:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788851228.447151:0:17943:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851228.447439:0:17943:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788851228.470906:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851228.856546:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00000040:00080000:1.0:1788851229.436522:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788851229.492250:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851229.877549:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 10000000:01000000:0.0:1788851229.941576:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851229.941583:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892eb6cf0800 from 8 10000000:01000000:0.0:1788851229.941589:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851229.941639:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851229.941651:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851229.941663:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851229.941689:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019787776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851229.941763:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851229.941828:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebffad240 going to sleep for 11 seconds 00000100:00100000:3.0:1788851229.941903:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019787776 00000100:00100000:3.0:1788851229.941912:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019787776 00000100:00100000:3.0:1788851229.941974:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788851229.941986:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+16:17209:x1875746019787776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851229.942000:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851229.942438:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206c14 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851229.942468:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206c14 expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851229.942479:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c14 expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851229.942501:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b9e00, rc 0) 00000100:00100000:3.0:1788851229.942600:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019787776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 617us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851229.942607:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788851229.947271:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019787776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851229.947301:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851229.947314:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851229.947496:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019787904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788851229.947564:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851229.947674:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebffad240 going to sleep for 11 seconds 00000100:00100000:1.0:1788851229.952284:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019787904 00000100:00100000:1.0:1788851229.952305:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019787904 00000100:00100000:1.0:1788851229.952484:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788851229.952496:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019787904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788851229.952521:0:17207:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788851229.952536:0:17207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788851229.952539:0:17207:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788851229.952674:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019787904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 180us (5109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851229.952683:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788851229.952836:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019787904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851229.952894:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851229.952905:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851229.952921:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851229.952931:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851229.952934:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e84cde000 from 8 10000000:01000000:0.0:1788851229.952937:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851229.952967:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851229.952976:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851229.952986:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851229.953005:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019788032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851229.953077:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851229.953114:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebffad240 going to sleep for 11 seconds 00000100:00100000:1.0:1788851229.953186:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019788032 00000100:00100000:1.0:1788851229.953191:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019788032 00000100:00100000:1.0:1788851229.953230:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788851229.953238:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019788032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851229.953248:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851229.953263:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206c22 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851229.953286:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206c22 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851229.953297:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c22 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851229.953306:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030400, rc 0) 00000100:00100000:1.0:1788851229.953610:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:17209:x1875746019788032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 372us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851229.953617:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788851229.960221:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019788032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851229.960255:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851229.960269:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851229.960474:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019788160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788851229.960545:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851229.960594:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851229.961133:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019788160 00000100:00100000:0.0:1788851229.961217:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019788160 00000100:00100000:0.0:1788851229.961427:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788851229.961447:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:17209:x1875746019788160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788851229.961470:0:17206:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788851229.961486:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788851229.961490:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788851229.961598:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:17209:x1875746019788160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851229.961607:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788851229.962999:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019788160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788851229.963126:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788851229.963138:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851229.963151:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851230.452641:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851230.516102:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851230.903546:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00010000:00010000:1.0:1788851231.542927:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851231.928487:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00010000:00010000:2.0:1788851232.573526:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851232.956826:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 0 seconds 00000001:02000400:0.0:1788851232.988455:0:18211:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788851233.589482:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851233.716461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788851233.716469:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788851233.716472:0:37:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851233.716491:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892ea576a000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851233.716514:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c35880 x1875746019788416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851233.716533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851233.716537:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851233.716540:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851233.716543:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851233.716568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851233.716571:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851233.716574:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851233.716576:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788851233.716628:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019788416:0@lo:38:kworker.0 00000100:00100000:0.0:1788851233.716692:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851233.716763:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019788544:0@lo:400:kworker.0 00000100:00100000:0.0:1788851233.716790:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851233.716809:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851233.716815:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019788672:0@lo:400:kworker.0 00000100:00100000:0.0:1788851233.716836:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851233.716863:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019788416 00000100:00100000:0.0:1788851233.716870:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019788416 00000100:00100000:0.0:1788851233.716893:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019788672 00000100:00100000:0.0:1788851233.716895:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019788672 00000100:00100000:0.0:1788851233.716919:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851233.716927:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019788416:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788851233.716954:0:17217:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:0.0:1788851233.716997:0:17217:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b206c30 00000004:00100000:0.0:1788851233.717035:0:17217:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788851233.717042:0:17217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788851233.717114:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019788544 00000100:00100000:0.0:1788851233.717118:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019788544 00000100:00100000:0.0:1788851233.717144:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851233.717151:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019788544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851233.717586:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019788288:0@lo:400:kworker.0 00000100:00100000:1.0:1788851233.717627:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851233.717655:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851233.717661:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019788800:0@lo:400:kworker.0 00000100:00100000:1.0:1788851233.717687:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851233.717717:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019788288 00000100:00100000:1.0:1788851233.717721:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019788288 00000100:00100000:1.0:1788851233.717751:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788851233.717758:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:3648:x1875746019788288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851233.717793:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:3648:x1875746019788288:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851233.717800:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788851233.717829:0:17214:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788851233.717837:0:17214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788851233.717870:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019788288:0@lo:400:kworker.0 00000100:00100000:0.0:1788851233.718060:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019788544:12345-0@lo:400:kworker.0 Request processed in 908us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851233.718067:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851233.718080:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019788800 00000100:00100000:0.0:1788851233.718084:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019788800 00000100:00100000:0.0:1788851233.718099:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851233.718114:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019788800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851233.718147:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019788800:12345-0@lo:400:kworker.0 Request processed in 34us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851233.718154:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851233.718344:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851233.718355:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019788928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851233.718392:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788851233.718686:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e87c35c00 x1875746019788544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851233.718698:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019788544:0@lo:400:kworker.0 00010000:00080000:1.0:1788851233.718772:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e87c35180 x1875746019788800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851233.718783:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019788800:0@lo:400:kworker.0 00000100:00100000:0.0:1788851233.718990:0:17218:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788851233.718998:0:17218:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788851233.719452:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019788928 00000100:00100000:2.0:1788851233.719460:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019788928 00000100:00100000:0.0:1788851233.719596:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788851233.719607:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3649:x1875746019788672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851233.719685:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3649:x1875746019788672:12345-0@lo:400:kworker.0 Request processed in 80us (2847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851233.719692:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788851233.719710:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788851233.719716:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019788928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851233.719758:0:18246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788851233.719801:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019788928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851233.719807:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788851233.719881:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019788672:0@lo:400:kworker.0 00000100:00100000:3.0:1788851233.720423:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019788928:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788851233.731610:0:17217:0:(import.c:65:import_set_state_nolock()) ffff892e88fa6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851233.732374:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875746019788416:12345-0@lo:38:kworker.0 Request processed in 15440us (15675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851233.732387:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788851233.733752:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788851233.733769:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788851233.733776:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788851233.733780:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788851233.733807:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c2e06858): req@ffff892ea5994380 x1875746019781504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851233.733833:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019788416:0@lo:38:kworker.0 00000100:00100000:3.0:1788851233.733997:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851233.734039:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019789056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851233.734105:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851233.734496:0:17253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851233.734523:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6e95240 going to sleep for 11 seconds 00000100:00100000:2.0:1788851233.734543:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019789056 00000100:00100000:2.0:1788851233.734549:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019789056 00000100:00100000:2.0:1788851233.734596:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019781504 00000100:00100000:2.0:1788851233.734599:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019781504 00000100:00100000:2.0:1788851233.734615:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851233.734623:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875746019789056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851233.734659:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851233.734712:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875746019789056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851233.734719:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851233.734734:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851233.734741:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17253:x1875746019781504:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788851233.734805:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17253:x1875746019781504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851233.734811:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851233.734838:0:17253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875746019781504:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788851233.734870:0:17253:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788851233.734904:0:17253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875746019789184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788851233.734932:0:17253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851233.734954:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea7e71480 going to sleep for 11 seconds 00000100:00100000:2.0:1788851233.734979:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019789184 00000100:00100000:2.0:1788851233.734983:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019789184 00000100:00100000:2.0:1788851233.734998:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788851233.735003:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17253:x1875746019789184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788851233.735223:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019789056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851233.735492:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17253:x1875746019789184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 488us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851233.735499:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788851233.735565:0:17253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875746019789184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788851233.735646:0:17253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875746019789312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788851233.735674:0:17253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851233.735696:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebffad6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851233.735740:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019789312 00000100:00100000:3.0:1788851233.735745:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019789312 00000100:00100000:3.0:1788851233.735785:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788851233.735792:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17253:x1875746019789312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788851233.735851:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17253:x1875746019789312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851233.735857:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788851233.735945:0:17253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875746019789312:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788851233.735998:0:17253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851233.740462:0:17253:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788851233.740550:0:17253:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:3.0:1788851233.740557:0:17253:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788851233.936955:0:18266:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851233.937441:0:18266:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788851234.627407:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788851234.786766:0:18316:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851234.786970:0:18316:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788851235.638305:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788851236.045855:0:18365:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff8714f10 20000000:00000080:3.0:1788851236.045871:0:18365:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892ebbc97800 uarg=0000000000000000 20000000:01000000:3.0:1788851236.045906:0:18365:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788851236.045913:0:18365:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788851236.045917:0:18365:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788851236.051478:0:18366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788851236.052385:0:18365:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788851236.066575:0:18365:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788851236.066607:0:18365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.066627:0:18365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206ad9 expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.066635:0:18365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206bdc expref: 17 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.066643:0:18365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.066690:0:18365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206bdc expref: 17 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.067987:0:18365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206bdc expref: 17 pid: 17207 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851236.068072:0:18365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1875746019789440:0@lo:104: 00000100:00100000:2.0:1788851236.068353:0:18365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851236.068464:0:18365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206ad9 expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.068473:0:18365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206ad9 expref: 17 pid: 17205 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851236.068481:0:18365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1875746019789568:0@lo:104: 00000100:00100000:2.0:1788851236.068503:0:18365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851236.073174:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019789440 00000100:00100000:3.0:1788851236.073187:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019789440 00000100:00100000:3.0:1788851236.073325:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019789568 00000100:00100000:3.0:1788851236.073328:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019789568 00000100:00100000:3.0:1788851236.073344:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851236.073351:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+4:18365:x1875746019789440:12345-0@lo:104: 00010000:00010000:3.0:1788851236.073370:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851236.073388:0:18365:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1480 going to sleep for 11 seconds 00010000:00010000:0.0:1788851236.079311:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788851236.079328:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+4:18365:x1875746019789440:12345-0@lo:104: Request processed in 5973us (10971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851236.079347:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788851236.079379:0:18365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1875746019789440:0@lo:104: 00000100:00100000:0.0:1788851236.079395:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851236.079407:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+3:18365:x1875746019789568:12345-0@lo:104: 00010000:00010000:0.0:1788851236.079425:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851236.079529:0:18365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1875746019789568:0@lo:104: 00010000:00010000:2.0:1788851236.079558:0:18365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851236.082617:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851236.082632:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851236.082643:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851236.082647:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851236.082677:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851236.082684:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851236.082689:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788851236.083997:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.084047:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851236.084053:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788851236.084073:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851236.084075:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+3:18365:x1875746019789568:12345-0@lo:104: Request processed in 4668us (15566us total) trans 0 rc 0/0 00010000:00010000:2.0:1788851236.084090:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206bdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206be3 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851236.084095:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788851236.084114:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851236.084119:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.084126:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788851236.084141:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851236.084148:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788851236.084150:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788851236.084159:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851236.084166:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019789696:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788851236.084167:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788851236.084189:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.084197:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788851236.084228:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.084236:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892d876e7000/0x3e0030720b206ad9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206ae0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851236.084248:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851236.084253:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851236.084256:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851236.084315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019789824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851236.084340:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851236.084695:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019789696 00000100:00100000:0.0:1788851236.084703:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019789696 00010000:00010000:0.0:1788851236.084730:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206bdc expref: 18 pid: 17207 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851236.084750:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019789824 00000100:00100000:0.0:1788851236.084753:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019789824 00010000:00010000:0.0:1788851236.084762:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206ad9 expref: 19 pid: 17205 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851236.084873:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851236.084880:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+19:3649:x1875746019789696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851236.084892:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851236.084897:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206bdc expref: 19 pid: 17207 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.084907:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206bdc expref: 19 pid: 17207 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.084919:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6000/0x3e0030720b206be3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206bdc expref: 19 pid: 17207 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.084931:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851236.084965:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+18:3649:x1875746019789696:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851236.084971:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851236.084983:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851236.084988:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+17:3647:x1875746019789824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851236.084995:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851236.084999:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206ad9 expref: 17 pid: 17205 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085008:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206ad9 expref: 17 pid: 17205 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085050:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e8a8b8e00/0x3e0030720b206ae0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206ad9 expref: 17 pid: 17205 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085326:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085334:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085348:0:17198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085355:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085361:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085366:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085371:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851236.085375:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085381:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851236.085476:0:17199:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788851236.085492:0:17199:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788851236.085685:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851236.085696:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851236.085733:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+16:3647:x1875746019789824:12345-0@lo:103:ldlm_bl.0 Request processed in 744us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851236.085744:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851236.086283:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019789696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851236.086319:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019789824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851236.087054:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851236.087293:0:18365:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851236.087306:0:18365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851236.087312:0:18365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6600/0x3e0030720b206c37 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851236.090260:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851236.663816:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851237.686249:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788851237.940377:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851237.940385:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892eb6cf0800 from 13 10000000:01000000:0.0:1788851237.940391:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851237.940433:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851237.940446:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851237.940457:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851237.940483:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019789952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851237.940553:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851237.940597:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851237.940889:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019789952 00000100:00100000:3.0:1788851237.940898:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019789952 00000100:00100000:3.0:1788851237.940947:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788851237.940957:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+16:17209:x1875746019789952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851237.940969:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851237.940984:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206c3e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.941052:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206c3e expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.941063:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c3e expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.941072:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8400, rc 0) 00000100:00100000:3.0:1788851237.941114:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019789952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851237.941122:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788851237.941180:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019789952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851237.941195:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.941204:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851237.941263:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.941291:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851237.941307:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851237.941320:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019790080 00000100:00100000:3.0:1788851237.941324:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019790080 00000100:00100000:3.0:1788851237.941346:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788851237.941351:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019790080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.941452:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019790080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851237.941469:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788851237.941501:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.941530:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.941565:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851237.941577:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851237.941588:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019790208 00000100:00100000:3.0:1788851237.941591:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019790208 00000100:00100000:3.0:1788851237.941610:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788851237.941615:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019790208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.941685:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019790208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851237.941692:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788851237.941728:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788851237.942420:0:18457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788851237.942490:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788851237.942507:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788851237.942514:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.942524:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851237.942534:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788851237.942536:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e84cde000 from 13 10000000:01000000:3.0:1788851237.942539:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788851237.942560:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.942573:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.942583:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851237.942597:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.942629:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851237.942645:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851237.942657:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019790336 00000100:00100000:3.0:1788851237.942661:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019790336 00000100:00100000:3.0:1788851237.942686:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788851237.942692:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+17:17209:x1875746019790336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851237.942700:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851237.942709:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206c4c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.942725:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206c4c expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.942734:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c4c expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.942741:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e8a8b8200, rc 0) 00000100:00100000:3.0:1788851237.942768:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:17209:x1875746019790336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851237.942774:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788851237.942819:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851237.942830:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851237.942838:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851237.942875:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.942897:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851237.942909:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851237.942920:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019790464 00000100:00100000:3.0:1788851237.942923:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019790464 00000100:00100000:3.0:1788851237.942942:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788851237.942948:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:17209:x1875746019790464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.943041:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:17209:x1875746019790464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851237.943048:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788851237.943077:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.943099:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.943133:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851237.943146:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851237.943157:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019790592 00000100:00100000:3.0:1788851237.943160:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019790592 00000100:00100000:3.0:1788851237.943191:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788851237.943197:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:17209:x1875746019790592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851237.943261:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:17209:x1875746019790592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851237.943273:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788851237.943306:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019790592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788851237.948363:0:18458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788851237.948431:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788851237.948457:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851237.948469:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851237.948483:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851238.004663:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851238.714241:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851238.837057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851238.837065:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788851238.837066:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788851238.837068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851238.837071:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851238.837088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788851238.837089:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019790720:0@lo:400:kworker.0 00000100:00080000:0.0:1788851238.837105:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851238.837108:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851238.837110:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788851238.837140:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019790848:0@lo:400:kworker.0 00000100:00100000:2.0:1788851238.837179:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851238.837195:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851238.837218:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851238.837220:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019791104:0@lo:400:kworker.0 00000100:00100000:0.0:1788851238.837222:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019790976:0@lo:400:kworker.0 00000100:00100000:2.0:1788851238.837244:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851238.837244:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851238.837259:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851238.837274:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019790976 00000100:00100000:2.0:1788851238.837276:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019791232:0@lo:400:kworker.0 00000100:00100000:0.0:1788851238.837281:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019790976 00000100:00100000:2.0:1788851238.837301:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851238.837321:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019791232 00000100:00100000:0.0:1788851238.837324:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019791232 00000100:00100000:2.0:1788851238.837325:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019790720 00000100:00100000:2.0:1788851238.837328:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019790720 00000100:00100000:0.0:1788851238.837342:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851238.837350:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019790976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851238.837370:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788851238.837376:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:3647:x1875746019790720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851238.837400:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019790976:12345-0@lo:400:kworker.0 Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851238.837402:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:3647:x1875746019790720:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851238.837407:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788851238.837407:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851238.837422:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851238.837428:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019791232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851238.837434:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019790848 00000100:00100000:2.0:1788851238.837437:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019790848 00000100:00100000:0.0:1788851238.837453:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019791232:12345-0@lo:400:kworker.0 Request processed in 25us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851238.837457:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019791104 00000100:00100000:0.0:1788851238.837459:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788851238.837460:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019791104 00000100:00100000:2.0:1788851238.837474:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851238.837477:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788851238.837479:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019790848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851238.837482:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019791104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851238.837506:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019790848:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851238.837506:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019791104:12345-0@lo:400:kworker.0 Request processed in 23us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851238.837512:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851238.837518:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788851238.837549:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892ea7d64e00 x1875746019791232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788851238.837549:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e87c35c00 x1875746019790976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851238.837562:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019791232:0@lo:400:kworker.0 00000100:00100000:0.0:1788851238.837562:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019790976:0@lo:400:kworker.0 00000100:00100000:0.0:1788851238.837571:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019790848:0@lo:400:kworker.0 00000100:00100000:2.0:1788851238.837573:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019791104:0@lo:400:kworker.0 00000100:00100000:2.0:1788851238.837579:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019790720:0@lo:400:kworker.0 00000100:00100000:2.0:1788851238.838476:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851238.838488:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019791360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851238.838528:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851238.838560:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019791360 00000100:00100000:2.0:1788851238.838565:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019791360 00000100:00100000:2.0:1788851238.838592:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788851238.838597:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019791360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788851238.838621:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788851238.838657:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019791360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851238.838663:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788851238.838697:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019791360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851238.839744:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851228/real 1788851228] req@ffff892ea7c37800 x1875746019784704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851238 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851238.839768:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea7c37800 x1875746019784704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851238 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851238.839778:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851228/real 1788851228] req@ffff892e87c34380 x1875746019784576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851238 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851238.839789:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892e87c34380 x1875746019784576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851238 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851238.839794:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019791488:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788851238.839801:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851238.839814:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851238.839817:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019784704:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788851238.839822:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eab226800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851238.839826:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851238.839829:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019784576:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788851238.839833:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851238.839863:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019791488 00000100:00100000:2.0:1788851238.839868:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019791488 00000100:00100000:2.0:1788851238.839908:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788851238.839915:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019791488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851238.839939:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851238.839973:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019791488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851238.839986:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788851238.840062:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019791488:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788851238.840703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851238.840709:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851238.840711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851238.840713:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851238.840717:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851238.840720:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788851238.840722:0:8:0:(import.c:65:import_set_state_nolock()) ffff892eab226800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851238.840727:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:0.0:1788851238.840732:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788851238.840740:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff892eab226800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851238.840768:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7d66680 x1875746019791616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851238.840791:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851238.840794:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788851238.840796:0:8:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851238.840799:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:0.0:1788851238.840802:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788851238.840815:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892ea4358800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851238.840828:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7d66300 x1875746019791744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851238.840904:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019791616:0@lo:8:kworker.0 00000400:00000100:1.0:1788851238.840935:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019791616 offset 0 length 520: 4 00000100:00100000:1.0:1788851238.840962:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019791744:0@lo:8:kworker.0 00000400:00000100:1.0:1788851238.840976:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019791744 offset 0 length 520: 4 00010000:00010000:3.0:1788851239.733333:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788851239.867687:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:0.0:1788851240.701080:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788851240.759908:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851240.885215:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851225/real 1788851225] req@ffff892ea5ad5500 x1875746019782528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851240 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851240.885246:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea5ad5500 x1875746019782528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851240 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851240.885268:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851225/real 1788851225] req@ffff892ea5ad5f80 x1875746019782656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851240 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851240.885280:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea5ad5f80 x1875746019782656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851240 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788851240.885299:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5769000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851240.885321:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851240.885325:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019782528:0@lo:8:kworker.0 00000100:00080000:1.0:1788851240.885330:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851240.885335:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851240.885338:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019782656:0@lo:8:kworker.0 00000100:00080000:3.0:1788851240.886229:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851240.886235:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788851240.886238:0:37:0:(import.c:65:import_set_state_nolock()) ffff892ea5769000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851240.886244:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1788851240.886251:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788851240.886262:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff892ea5769000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851240.886284:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5996680 x1875746019792128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851240.886300:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851240.886303:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788851240.886305:0:37:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851240.886308:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1788851240.886310:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788851240.886314:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892e88540000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851240.886325:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5995c00 x1875746019792256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851240.886354:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851240.886357:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788851240.886367:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851240.886369:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788851240.886400:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019792000:0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.886475:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851240.886523:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788851240.886530:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019791872:0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.886558:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851240.886580:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019792640:0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.886604:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851240.886633:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019792128:0@lo:8:kworker.0 00000400:00000100:3.0:1788851240.886650:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019792128 offset 0 length 520: 4 00000100:00100000:3.0:1788851240.886661:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019792256:0@lo:8:kworker.0 00000400:00000100:3.0:1788851240.886679:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019792256 offset 0 length 520: 4 00000100:00100000:3.0:1788851240.886698:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019792384:0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.886723:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851240.886741:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851240.886745:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019792512:0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.886766:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851240.886795:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019792000 00000100:00100000:3.0:1788851240.886803:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019792000 00000100:00100000:3.0:1788851240.886840:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019792512 00000100:00100000:3.0:1788851240.886844:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019792512 00000100:00100000:3.0:1788851240.886859:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788851240.886867:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019792000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.886927:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019792000:12345-0@lo:400:kworker.0 Request processed in 60us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851240.886936:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788851240.886955:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788851240.886960:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019792512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.886991:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019792512:12345-0@lo:400:kworker.0 Request processed in 31us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851240.886997:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788851240.887035:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019791872 00000100:00100000:3.0:1788851240.887052:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019791872 00000100:00100000:3.0:1788851240.887081:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788851240.887088:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:3648:x1875746019791872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.887130:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:3648:x1875746019791872:12345-0@lo:400:kworker.0 Request processed in 43us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851240.887136:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788851240.887172:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019792640 00000100:00100000:3.0:1788851240.887175:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019792640 00000100:00100000:3.0:1788851240.887199:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019792384 00000100:00100000:3.0:1788851240.887202:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019792384 00000100:00100000:3.0:1788851240.887220:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851240.887226:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019792640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.887257:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019792640:12345-0@lo:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851240.887261:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851240.887272:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851240.887278:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019792384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.887316:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019792384:12345-0@lo:400:kworker.0 Request processed in 38us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851240.887322:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851240.887362:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019791872:0@lo:400:kworker.0 00010000:00080000:3.0:1788851240.887373:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892ea5995500 x1875746019792640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851240.887383:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019792640:0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.887392:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019792000:0@lo:400:kworker.0 00000100:00100000:3.0:1788851240.887414:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019792512:0@lo:400:kworker.0 00010000:00080000:3.0:1788851240.887422:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892ea5994000 x1875746019792384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851240.887429:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019792384:0@lo:400:kworker.0 00010000:00010000:3.0:1788851241.781270:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788851242.696705:0:18714:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788851242.696709:0:18714:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788851242.696710:0:18714:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788851242.696862:0:18714:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892ea4305000 00000020:01000004:0.0:1788851242.696884:0:18714:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788851242.696898:0:18714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788851242.697321:0:18714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff892e83e3b380) 00000020:00000080:0.0:1788851242.697341:0:18714:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788851242.753332:0:18714:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788851242.758483:0:18714:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788851242.758928:0:18714:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788851242.759301:0:18714:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788851242.759702:0:18714:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788851242.759967:0:18714:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788851242.760453:0:18714:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788851242.762456:0:18714:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788851242.762779:0:18714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788851242.762801:0:18714:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788851242.762819:0:18714:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e0030720b206c61 00000020:01000004:2.0:1788851242.762829:0:18714:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788851242.762929:0:18714:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788851242.762934:0:18714:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788851242.762941:0:18714:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788851242.762949:0:18714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788851242.762966:0:18714:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff892d87ac3380) 00000020:00000080:2.0:1788851242.762981:0:18714:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788851242.768820:0:18714:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851242.769118:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788851242.769128:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788851242.775453:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788851242.775472:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788851242.780658:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788851242.780676:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788851242.803222:0:18714:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788851242.803435:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788851242.803441:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00010000:00010000:1.0:1788851242.804720:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851242.810368:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788851242.810389:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788851242.835761:0:18714:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851242.836378:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788851242.836385:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788851242.837846:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788851242.837857:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788851242.839235:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788851242.839246:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788851242.843210:0:18714:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851242.843424:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788851242.843430:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788851242.844301:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788851242.844310:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788851242.918244:0:18714:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851242.919982:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788851242.919991:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788851242.929577:0:18714:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788851242.929596:0:18714:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788851242.930294:0:18714:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788851242.930322:0:18714:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788851242.930328:0:18714:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788851242.952445:0:18714:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788851242.952508:0:18714:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788851242.952517:0:18714:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788851242.952519:0:18714:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851242.952520:0:18714:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851242.952521:0:18714:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851242.952523:0:18714:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851242.952524:0:18714:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851242.952525:0:18714:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851242.952527:0:18714:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851242.952528:0:18714:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788851242.952532:0:18714:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788851242.952534:0:18714:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788851242.952536:0:18714:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851242.952537:0:18714:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851242.952538:0:18714:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851242.952539:0:18714:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851242.952540:0:18714:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851242.952541:0:18714:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851242.952542:0:18714:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851242.952543:0:18714:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788851242.952592:0:18714:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788851242.952620:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019792768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788851242.952901:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851242.953056:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851242.957398:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019792768 00000100:00100000:2.0:1788851242.957420:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019792768 00000100:00100000:0.0:1788851242.957632:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788851242.957647:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:18714:x1875746019792768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788851242.957702:0:17205:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788851242.957707:0:17205:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788851242.957712:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788851242.958254:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+18:18714:x1875746019792768:12345-0@lo:253:mount.lustre.0 Request processed in 608us (5350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851242.958263:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788851242.958373:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019792768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788851242.958390:0:18714:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788851242.958394:0:18714:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788851242.958396:0:18714:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851242.958397:0:18714:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851242.958399:0:18714:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851242.958400:0:18714:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851242.958401:0:18714:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851242.958403:0:18714:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851242.958405:0:18714:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851242.958406:0:18714:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788851242.958433:0:18714:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892ea4305000 from lustre-OST0000 10000000:01000000:1.0:1788851242.958495:0:18714:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788851242.958498:0:18714:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788851242.958512:0:18714:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff892d85f23380 local copy 00010000:00010000:1.0:1788851242.958524:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851242.958647:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019792896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851242.958694:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851242.958735:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851242.958983:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019792896 00000100:00100000:3.0:1788851242.958999:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019792896 00000100:00100000:3.0:1788851242.959539:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788851242.959551:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:18714:x1875746019792896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851242.959728:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+18:18714:x1875746019792896:12345-0@lo:501:mount.lustre.0 Request processed in 179us (1033us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788851242.959737:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788851242.959846:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019792896:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788851242.959870:0:18714:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788851242.959917:0:18714:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788851242.959928:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851242.959940:0:18714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851242.959982:0:18714:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892ea4305000 10000000:01000000:1.0:1788851242.959988:0:18714:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788851242.959996:0:18714:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788851242.959999:0:18714:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788851242.960005:0:18714:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788851242.960008:0:18714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788851242.960088:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851242.960099:0:18714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851242.960111:0:18714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851242.960139:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851242.960179:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851242.966429:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851242.968497:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019793024 00000100:00100000:0.0:1788851242.968516:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019793024 00000100:00100000:0.0:1788851242.968579:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788851242.968607:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+18:18714:x1875746019793024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851242.968627:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851242.968648:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea55bca00/0x3e0030720b206c76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206c6f expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851242.968680:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea55bca00/0x3e0030720b206c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206c6f expref: 19 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851242.968691:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea55bca00/0x3e0030720b206c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c6f expref: 19 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851242.968700:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bca00, rc 0) 00000100:00100000:0.0:1788851242.968808:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793024:12345-0@lo:101:mount.lustre.0 Request processed in 203us (8627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851242.968816:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788851242.968902:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851242.968936:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851242.968965:0:18714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788851242.971644:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788851242.972516:0:18714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851242.977119:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788851242.977214:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788851242.977260:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788851242.977277:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788851242.977293:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788851242.977308:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788851242.977343:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788851242.977350:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788851242.977521:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851242.977634:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851242.977707:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86aadf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851242.979242:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019793152 00000100:00100000:3.0:1788851242.979258:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019793152 00000100:00100000:3.0:1788851242.979326:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788851242.979336:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851242.979567:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793152:12345-0@lo:501:mount.lustre.0 Request processed in 233us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851242.979575:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851242.982008:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851242.982108:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851242.982184:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851242.982227:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851242.982452:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019793280 00000100:00100000:0.0:1788851242.982467:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019793280 00000100:00100000:0.0:1788851242.982543:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788851242.982554:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851242.983806:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793280:12345-0@lo:503:mount.lustre.0 Request processed in 1248us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851242.983820:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788851242.984147:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788851242.985354:0:18714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788851242.985511:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851242.986552:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851242.987446:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851242.990295:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019793408 00000100:00100000:2.0:1788851242.990318:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019793408 00000100:00100000:2.0:1788851242.990403:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788851242.990416:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851242.992185:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793408:12345-0@lo:502:mount.lustre.0 Request processed in 1759us (5627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851242.992334:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788851243.002664:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851243.003329:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788851243.003379:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788851243.003394:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788851243.003406:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788851243.003419:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788851243.003431:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788851243.003444:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788851243.003467:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788851243.003479:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788851243.003492:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788851243.003504:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788851243.003516:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788851243.003565:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851243.003643:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851243.003689:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebbb26c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851243.004141:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019793536 00000100:00100000:3.0:1788851243.004154:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019793536 00000100:00100000:3.0:1788851243.004232:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788851243.004244:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851243.004478:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793536:12345-0@lo:502:mount.lustre.0 Request processed in 235us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851243.004488:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788851243.004786:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788851243.004886:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788851243.004904:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788851243.007915:0:18731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788851243.007928:0:18731:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788851243.007935:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851243.007937:0:18731:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788851243.007944:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788851243.007962:0:18731:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff892eb6f40000) 00000020:00000080:1.0:1788851243.007988:0:18731:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788851243.007994:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788851243.008110:0:18731:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892ea4305000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788851243.008119:0:18731:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788851243.008126:0:18731:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e0030720b206c84 00010000:00010000:0.0:1788851243.015112:0:18731:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788851243.017466:0:18731:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1788851243.019665:0:18731:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788851243.021678:0:18731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788851243.021690:0:18731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851243.021696:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851243.021699:0:18731:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788851243.021702:0:18731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788851243.021705:0:18731:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788851243.021706:0:18731:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851243.021708:0:18731:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851243.021709:0:18731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788851243.021711:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851243.021713:0:18731:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788851243.021715:0:18731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851243.021718:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851243.021720:0:18731:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788851243.021723:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788851243.021725:0:18731:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788851243.021727:0:18731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851243.021729:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851243.021730:0:18731:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788851243.021733:0:18731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851243.021735:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851243.021736:0:18731:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788851243.021747:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788851243.021792:0:18731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851243.021796:0:18731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851243.021797:0:18731:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788851243.021801:0:18731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788851243.021912:0:18714:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788851243.021967:0:18714:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788851243.021996:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.022047:0:18714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851243.022058:0:18714:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea4305000 from 1 10000000:01000000:3.0:1788851243.022061:0:18714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788851243.022135:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.022145:0:18714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.022160:0:18714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851243.022192:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851243.022280:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851243.022333:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86035540 going to sleep for 11 seconds 00000100:00100000:0.0:1788851243.022495:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019793664 00000100:00100000:0.0:1788851243.022506:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019793664 00000100:00100000:0.0:1788851243.022557:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788851243.022567:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+19:18714:x1875746019793664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851243.022585:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851243.022606:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206c8b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.022635:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206c8b expref: 20 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.022647:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c8b expref: 20 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.022656:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bd000, rc 0) 00000100:00100000:0.0:1788851243.022734:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019793664:12345-0@lo:101:mount.lustre.0 Request processed in 168us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851243.022744:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788851243.022786:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851243.022813:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.022824:0:18714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851243.023870:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788851243.025351:0:18714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851243.025747:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788851243.025779:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788851243.025800:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788851243.025806:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788851243.025919:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851243.026005:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851243.028782:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019793792 00000100:00100000:2.0:1788851243.028801:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019793792 00000100:00100000:2.0:1788851243.028891:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788851243.028903:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019793792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851243.029329:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e88d62900 going to sleep for 11 seconds 00000100:00100000:2.0:1788851243.029448:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019793792:12345-0@lo:501:mount.lustre.0 Request processed in 546us (3442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851243.029459:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788851243.029659:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851243.029735:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851243.029792:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851243.029830:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e88d62900 going to sleep for 11 seconds 00000100:00100000:2.0:1788851243.029891:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019793920 00000100:00100000:2.0:1788851243.029898:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019793920 00000100:00100000:2.0:1788851243.029944:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788851243.029953:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019793920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851243.030165:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019793920:12345-0@lo:503:mount.lustre.0 Request processed in 213us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851243.030173:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788851243.030279:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019793920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788851243.035493:0:18714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788851243.035708:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851243.035833:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851243.035938:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9068bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851243.037698:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019794048 00000100:00100000:2.0:1788851243.037717:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019794048 00000100:00100000:2.0:1788851243.037805:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788851243.037816:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8678a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019794048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851243.038201:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8678a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019794048:12345-0@lo:502:mount.lustre.0 Request processed in 387us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851243.038212:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788851243.038344:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851243.038673:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788851243.038717:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788851243.038739:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788851243.038756:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788851243.038772:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788851243.038785:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788851243.038801:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788851243.038816:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788851243.038832:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788851243.038847:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788851243.038880:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788851243.038925:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851243.038985:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851243.039095:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86035540 going to sleep for 11 seconds 00000100:00100000:2.0:1788851243.039306:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019794176 00000100:00100000:2.0:1788851243.039315:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019794176 00000100:00100000:2.0:1788851243.039372:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788851243.039383:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8678a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019794176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851243.039510:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8678a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019794176:12345-0@lo:502:mount.lustre.0 Request processed in 129us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851243.039518:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788851243.040161:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788851243.040269:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788851243.040286:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788851243.043182:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851243.043202:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851243.043205:0:18734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788851243.043215:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892ea4305000 00000020:00000080:3.0:1788851243.043231:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788851243.043243:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851243.043247:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851243.043248:0:18734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788851243.043251:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851243.043254:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851243.043256:0:18734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788851243.043259:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892ea4305000 00000020:00000080:3.0:1788851243.043262:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788851243.043327:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851243.043331:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851243.043332:0:18734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788851243.043335:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851243.043338:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851243.043340:0:18734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788851243.043343:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892ea4305000 00000020:00000080:3.0:1788851243.043346:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788851243.043364:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851243.043368:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851243.043369:0:18734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788851243.043371:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851243.043374:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851243.043375:0:18734:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788851243.043379:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892ea4305000 00000020:00000080:3.0:1788851243.043381:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788851243.043404:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851243.043407:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851243.043409:0:18734:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788851243.043412:0:18734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788851243.053474:0:18714:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788851243.053630:0:18714:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851243.053665:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.053682:0:18714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851243.053786:0:18714:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788851243.053790:0:18714:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892ea4305000 10000000:01000000:1.0:1788851243.053794:0:18714:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892ea4305000 10000000:01000000:1.0:1788851243.053800:0:18714:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788851243.053808:0:18714:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892ea4305000 from 1 10000000:01000000:1.0:1788851243.053811:0:18714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788851243.053865:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.053876:0:18714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.053891:0:18714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851243.053926:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851243.054143:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851243.054202:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788851243.057414:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019794304 00000100:00100000:2.0:1788851243.057435:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019794304 00000100:00100000:2.0:1788851243.057535:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788851243.057549:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+20:18714:x1875746019794304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851243.057583:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851243.057607:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6800/0x3e0030720b206ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206c99 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851243.057646:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6800/0x3e0030720b206ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206c99 expref: 21 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851243.057661:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6800/0x3e0030720b206ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c99 expref: 21 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851243.057672:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6800, rc 0) 00000100:00100000:2.0:1788851243.057789:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794304:12345-0@lo:101:mount.lustre.0 Request processed in 244us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851243.057798:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788851243.058032:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851243.058062:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.058086:0:18714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851243.061452:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788851243.062442:0:18714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851243.062819:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788851243.062852:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788851243.062868:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788851243.062883:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788851243.062896:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788851243.062910:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788851243.062924:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788851243.062939:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788851243.062953:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788851243.062965:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788851243.062978:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788851243.062992:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788851243.063051:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788851243.063080:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788851243.063112:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788851243.063129:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788851243.063143:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788851243.063155:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788851243.063168:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788851243.063181:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788851243.063209:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788851243.063225:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788851243.063239:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788851243.063254:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788851243.063270:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788851243.063285:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788851243.063300:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788851243.063316:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788851243.063331:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788851243.063345:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788851243.063375:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788851243.063392:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788851243.063407:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788851243.063421:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788851243.063435:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788851243.063451:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788851243.063466:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788851243.063493:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788851243.063500:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788851243.067616:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851243.067713:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851243.067770:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851243.070433:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019794432 00000100:00100000:3.0:1788851243.070454:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019794432 00000100:00100000:3.0:1788851243.070564:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788851243.070579:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851243.070838:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794432:12345-0@lo:501:mount.lustre.0 Request processed in 262us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851243.070847:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788851243.071081:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851243.071150:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851243.071209:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851243.071240:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851243.071539:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019794560 00000100:00100000:2.0:1788851243.071546:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019794560 00000100:00100000:2.0:1788851243.071594:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788851243.071603:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851243.071715:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794560:12345-0@lo:503:mount.lustre.0 Request processed in 113us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851243.071723:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788851243.073405:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788851243.074099:0:18714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788851243.074237:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851243.074340:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851243.081572:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851243.083387:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019794688 00000100:00100000:3.0:1788851243.083410:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019794688 00000100:00100000:3.0:1788851243.083532:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788851243.083544:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851243.083980:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794688:12345-0@lo:502:mount.lustre.0 Request processed in 437us (9639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851243.083990:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788851243.085524:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851243.085940:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788851243.085978:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788851243.085991:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788851243.086130:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788851243.086152:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788851243.086189:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788851243.086218:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788851243.086236:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788851243.086251:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788851243.086267:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788851243.086289:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788851243.086312:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788851243.086334:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788851243.086354:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788851243.086378:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788851243.086405:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788851243.086426:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788851243.086446:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788851243.086466:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788851243.086492:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788851243.086532:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788851243.086552:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788851243.086659:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788851243.086685:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788851243.086710:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788851243.086730:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788851243.086750:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788851243.086773:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788851243.086800:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788851243.086816:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788851243.086838:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788851243.086862:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788851243.086882:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788851243.086908:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788851243.086930:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788851243.086949:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788851243.086980:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788851243.086995:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788851243.087667:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788851243.087693:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788851243.087721:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788851243.087748:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788851243.087776:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788851243.087805:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788851243.087824:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788851243.087848:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788851243.087876:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788851243.087903:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788851243.087989:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851243.088135:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851243.088190:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d88865180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851243.088819:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019794816 00000100:00100000:1.0:1788851243.088834:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019794816 00000100:00100000:1.0:1788851243.088912:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788851243.088924:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851243.089144:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794816:12345-0@lo:502:mount.lustre.0 Request processed in 220us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851243.089153:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788851243.089200:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851243.089540:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788851243.089647:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788851243.089689:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851243.089760:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851243.089817:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d88865b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851243.090119:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019794944 00000100:00100000:2.0:1788851243.090127:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019794944 00000100:00100000:2.0:1788851243.090170:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788851243.090178:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851243.090291:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019794944:12345-0@lo:502:mount.lustre.0 Request processed in 115us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851243.090305:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788851243.090332:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019794944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851243.090405:0:18714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788851243.090415:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788851243.091638:0:18739:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788851243.091655:0:18739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff892eb6f43380) 00000020:00000080:1.0:1788851243.091753:0:18739:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788851243.091864:0:18739:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892ea4305000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788851243.092786:0:18739:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ea4305000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788851243.092790:0:18739:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea4305000 3 00010000:00080000:1.0:1788851243.092842:0:18739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d85f3b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1788851243.096178:0:18739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788851243.096364:0:18739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788851243.096413:0:18739:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788851243.096921:0:18739:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3e0030720b206cae 00000100:00080000:2.0:1788851243.096937:0:18739:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788851243.096950:0:18739:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff892d85f3b800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851243.096990:0:18739:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c36300 x1875746019795072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851243.097486:0:18739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788851243.098707:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019795072:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1788851243.098807:0:18739:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000100:00100000:1.0:1788851243.098824:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788851243.098825:0:18739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff892d87ac4d40) 00000020:00000080:2.0:1788851243.098853:0:18739:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788851243.098933:0:18739:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892ea4305000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788851243.098937:0:18739:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ea4305000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788851243.098939:0:18739:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea4305000 3 00000100:00080000:1.0:1788851243.098969:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851243.098975:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851243.098980:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00080000:2.0:1788851243.098981:0:18739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d81a18800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.127@tcp at head 00000100:00080000:1.0:1788851243.098989:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851243.099060:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851243.099073:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851243.099076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851243.099092:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788851243.099142:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019795200:0@lo:400:kworker.0 00000100:00100000:1.0:1788851243.099183:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851243.099211:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851243.099218:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019795584:0@lo:400:kworker.0 00000100:00100000:1.0:1788851243.099244:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851243.099287:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019795328:0@lo:400:kworker.0 00000100:00100000:1.0:1788851243.099314:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851243.099337:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851243.099344:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019795456:0@lo:400:kworker.0 00000100:00100000:1.0:1788851243.099370:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851243.099422:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019795200 00000100:00100000:1.0:1788851243.099433:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019795200 00000100:00100000:1.0:1788851243.099486:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019795456 00000100:00100000:1.0:1788851243.099490:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019795456 00000100:00100000:1.0:1788851243.099511:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788851243.099523:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019795200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851243.099695:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019795072 00000100:00100000:0.0:1788851243.099700:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019795072 00000100:00100000:0.0:1788851243.099732:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019795584 00000100:00100000:0.0:1788851243.099735:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019795584 00000100:00100000:0.0:1788851243.099754:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019795328 00000100:00100000:0.0:1788851243.099757:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019795328 00000100:00100000:0.0:1788851243.099778:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788851243.099796:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019795584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851243.099858:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019795584:12345-0@lo:400:kworker.0 Request processed in 64us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851243.099867:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788851243.099889:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851243.099897:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019795328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851243.099934:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019795328:12345-0@lo:400:kworker.0 Request processed in 38us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851243.099941:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851243.099954:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851243.099958:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019795072:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788851243.099986:0:17213:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:0.0:1788851243.100076:0:17213:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e0030720b206cbc 00000004:00100000:0.0:1788851243.100096:0:17213:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788851243.100143:0:17213:0:(import.c:65:import_set_state_nolock()) ffff892d81b6f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851243.100193:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875746019795072:12345-0@lo:38:llog_process_th.0 Request processed in 233us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851243.100201:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851243.100396:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019795200:12345-0@lo:400:kworker.0 Request processed in 875us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851243.100404:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788851243.100425:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788851243.100433:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019795456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851243.100468:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019795456:12345-0@lo:400:kworker.0 Request processed in 34us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851243.100475:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788851243.100534:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892ea7c36300 x1875746019795072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851243.101420:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851243.101436:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788851243.101449:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788851243.101455:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788851243.101459:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85f3b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788851243.101469:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019795072:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788851243.101537:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892ea5ad5f80 x1875746019795584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851243.101551:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019795584:0@lo:400:kworker.0 00000100:00100000:1.0:1788851243.102388:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019795200:0@lo:400:kworker.0 00000100:00100000:1.0:1788851243.102444:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019795456:0@lo:400:kworker.0 00010000:00080000:1.0:1788851243.102464:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892ea5ad7b80 x1875746019795328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851243.102476:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019795328:0@lo:400:kworker.0 00010000:00010000:2.0:1788851243.103237:0:18739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788851243.103451:0:18739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788851243.103496:0:18739:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788851243.103510:0:18739:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x3e0030720b206cc3 00000100:00080000:2.0:1788851243.103520:0:18739:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788851243.103532:0:18739:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff892d81a18800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851243.103569:0:18739:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c36d80 x1875746019795712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851243.103597:0:18739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788851243.103826:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019795712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788851243.103905:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851243.104180:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019795712 00000100:00100000:2.0:1788851243.104192:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019795712 00000100:00100000:2.0:1788851243.104239:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788851243.104246:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875746019795712:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788851243.104271:0:18245:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:2.0:1788851243.104298:0:18245:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x3e0030720b206cca 00000004:00100000:2.0:1788851243.104313:0:18245:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788851243.104342:0:18245:0:(import.c:65:import_set_state_nolock()) ffff892d81a1e000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788851243.104391:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851243.104400:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788851243.104407:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875746019795712:12345-0@lo:38:llog_process_th.0 Request processed in 155us (498us total) trans 0 rc 0/0 00000100:00080000:1.0:1788851243.104408:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851243.104423:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851243.104430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788851243.104431:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788851243.104443:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851243.104461:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851243.104465:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1788851243.104524:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892ea7c36d80 x1875746019795712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851243.104535:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788851243.104543:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788851243.104551:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788851243.104556:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788851243.104559:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d81a18800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788851243.104565:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019795712:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788851243.105159:0:18739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788851243.105237:0:18714:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788851243.105287:0:18714:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788851243.105302:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851243.105313:0:18714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788851243.105370:0:18714:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788851243.105374:0:18714:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788851243.105376:0:18714:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851243.105378:0:18714:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851243.105380:0:18714:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851243.105381:0:18714:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851243.105383:0:18714:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851243.105384:0:18714:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851243.105386:0:18714:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788851243.105389:0:18714:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788851243.105392:0:18714:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788851243.105393:0:18714:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788851243.105398:0:18714:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851243.105399:0:18714:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851243.105400:0:18714:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851243.105401:0:18714:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851243.105402:0:18714:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851243.105404:0:18714:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851243.105405:0:18714:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788851243.105423:0:18714:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788851243.105437:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019795840:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788851243.105480:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851243.105509:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86aad300 going to sleep for 11 seconds 00000100:00100000:2.0:1788851243.106125:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019795840 00000100:00100000:2.0:1788851243.106132:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019795840 00000100:00100000:2.0:1788851243.106168:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788851243.106175:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019795840:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788851243.106197:0:17206:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788851243.106210:0:17206:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788851243.113197:0:17206:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788851243.113213:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788851243.113281:0:17228:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788851243.113285:0:17228:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788851243.113306:0:17228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.113326:0:17228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c14 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.113335:0:17228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c22 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.113397:0:17228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.113435:0:17228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206c22 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.113451:0:17228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206c22 expref: 21 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851243.113476:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019795968:0@lo:104: 00000100:00100000:1.0:1788851243.113726:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788851243.113773:0:17228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206c14 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851243.113784:0:17228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206c14 expref: 21 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851243.113800:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019796096:0@lo:104: 00000100:00100000:0.0:1788851243.113811:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019795968 00000100:00100000:1.0:1788851243.113827:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851243.113828:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019795968 00000100:00100000:1.0:1788851243.113912:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead02cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851243.113923:0:17196:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788851243.113944:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019796096 00000100:00100000:0.0:1788851243.113948:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019796096 00000100:00100000:0.0:1788851243.113977:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851243.113990:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+4:17228:x1875746019795968:12345-0@lo:104: 00010000:00010000:0.0:1788851243.114220:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.114348:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788851243.114356:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+4:17228:x1875746019795968:12345-0@lo:104: Request processed in 369us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851243.114368:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851243.114392:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788851243.114399:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d86971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+3:17228:x1875746019796096:12345-0@lo:104: 00010000:00010000:0.0:1788851243.114408:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.114465:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788851243.114471:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d86971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+3:17228:x1875746019796096:12345-0@lo:104: Request processed in 73us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851243.114477:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788851243.114535:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851243.114611:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114623:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851243.114635:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114647:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851243.114655:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851243.114661:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788851243.114706:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114713:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851243.114735:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114743:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea55bc000/0x3e0030720b206c22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c29 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114754:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851243.114757:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114763:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bce00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851243.114766:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114773:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851243.114788:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851243.114794:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788851243.114807:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114812:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851243.114827:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114834:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206c14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c1b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.114847:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851243.114849:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851243.114852:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851243.114868:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019796224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851243.114911:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851243.114968:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019796352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851243.114991:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788851243.115166:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851243.115223:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:18714:x1875746019795840:12345-0@lo:253:mount.lustre.0 Request processed in 9048us (9742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851243.115234:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788851243.115283:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:18714:1875746019795840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788851243.115294:0:18714:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788851243.115297:0:18714:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788851243.115299:0:18714:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851243.115300:0:18714:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851243.115302:0:18714:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851243.115303:0:18714:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851243.115305:0:18714:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851243.115306:0:18714:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851243.115308:0:18714:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851243.115309:0:18714:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788851243.115321:0:18714:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788851243.115442:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019796224 00000100:00100000:3.0:1788851243.115448:0:17199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019796224 00010000:00010000:3.0:1788851243.115471:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c22 expref: 21 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851243.115488:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019796352 00000100:00100000:3.0:1788851243.115491:0:17199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019796352 00010000:00010000:3.0:1788851243.115506:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c14 expref: 22 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851243.115524:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851243.115531:0:17199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a8a82bd-f416-4736-bb65-b562856c988b+22:3648:x1875746019796224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851243.115608:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851243.115614:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c22 expref: 22 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.115625:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206c22 expref: 22 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.115642:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851243.115676:0:17199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a8a82bd-f416-4736-bb65-b562856c988b+22:3648:x1875746019796224:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851243.115684:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851243.115697:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788851243.115714:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+21:3649:x1875746019796352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851243.115730:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019796224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851243.115731:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851243.115748:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c14 expref: 21 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.115766:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80030400/0x3e0030720b206c29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206c22 expref: 21 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.115769:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206c14 expref: 21 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851243.115801:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019795968:0@lo:104: 00010000:00010000:3.0:1788851243.115818:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e8a8b9e00/0x3e0030720b206c1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206c14 expref: 20 pid: 17205 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.115818:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851243.115860:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019796096:0@lo:104: 00010000:00010000:0.0:1788851243.115862:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.116411:0:17228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788851243.116546:0:17197:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003259893s 00010000:00010000:0.0:1788851243.116555:0:17197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.116633:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.116642:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.116651:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.116659:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851243.116665:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.116675:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.116705:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851243.116722:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851243.116775:0:17228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.116791:0:17228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851243.116799:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031000/0x3e0030720b206cd1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851243.116803:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+19:3649:x1875746019796352:12345-0@lo:103:ldlm_bl.0 Request processed in 1091us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851243.116836:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788851243.116908:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019796352:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788851243.118222:0:18714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788851243.122090:0:18714:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788851243.122104:0:18714:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788851243.122170:0:18714:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788851243.122264:0:18714:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788851243.122453:0:18714:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788851243.122488:0:18714:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788851243.126495:0:18714:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788851243.127058:0:18714:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788851243.832219:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851243.956360:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851243.956386:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019796480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851243.956455:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851243.956673:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851243.956683:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019796608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851243.956712:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851243.956829:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019796480 00000100:00100000:0.0:1788851243.956847:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019796480 00000100:00100000:0.0:1788851243.956899:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019796608 00000100:00100000:0.0:1788851243.956902:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019796608 00000100:00100000:0.0:1788851243.956921:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788851243.956929:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019796480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788851243.956964:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788851243.957059:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019796480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851243.957066:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788851243.957085:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788851243.957092:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019796608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851243.957109:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788851243.957143:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019796608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851243.957149:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788851243.957191:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019796608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851243.957271:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019796480:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788851244.272818:0:18792:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788851244.274500:0:18792:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788851244.410586:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788851244.410595:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892eb6cf0800 from 9 10000000:01000000:2.0:1788851244.410600:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788851244.410659:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851244.410673:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851244.410685:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851244.410712:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019796736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788851244.410800:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851244.410844:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86aad6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851244.412067:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019796736 00000100:00100000:0.0:1788851244.412078:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019796736 00000100:00100000:0.0:1788851244.412133:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788851244.412143:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+19:17209:x1875746019796736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851244.412160:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851244.412177:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206cd8 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412211:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206cd8 expref: 20 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412220:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206cd8 expref: 20 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412229:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc200, rc 0) 00000100:00100000:0.0:1788851244.412284:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+20:17209:x1875746019796736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851244.412291:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788851244.412343:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019796736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851244.412358:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412368:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851244.412421:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019796864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788851244.412455:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851244.412481:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788851244.412494:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019796864 00000100:00100000:0.0:1788851244.412498:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019796864 00000100:00100000:0.0:1788851244.412519:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788851244.412526:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+20:17209:x1875746019796864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788851244.412539:0:17206:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788851244.412554:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788851244.412560:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788851244.412629:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+20:17209:x1875746019796864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851244.412636:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788851244.412681:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019796864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851244.412736:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851244.412743:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412752:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851244.412760:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851244.412763:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e84cde000 from 9 10000000:01000000:0.0:1788851244.412765:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851244.412781:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412790:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412798:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851244.412810:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019796992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851244.412834:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851244.412848:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788851244.412858:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019796992 00000100:00100000:0.0:1788851244.412861:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019796992 00000100:00100000:0.0:1788851244.412887:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788851244.412893:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+20:17209:x1875746019796992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851244.412900:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851244.412908:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206ce6 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412922:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206ce6 expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412930:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206ce6 expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.412937:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bd400, rc 0) 00000100:00100000:0.0:1788851244.412963:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:17209:x1875746019796992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851244.412970:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788851244.412998:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019796992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851244.413007:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.413037:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851244.413084:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019797120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788851244.413110:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851244.413121:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788851244.413131:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019797120 00000100:00100000:0.0:1788851244.413134:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019797120 00000100:00100000:0.0:1788851244.413158:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788851244.413164:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:17209:x1875746019797120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788851244.413173:0:17206:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788851244.413182:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788851244.413185:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788851244.413239:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:17209:x1875746019797120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851244.413246:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788851244.413272:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019797120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851244.413305:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851244.413310:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851244.413319:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851244.853263:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851245.879714:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851246.902632:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851247.924220:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851248.247707:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788851248.565338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851248.565353:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851248.565356:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851248.565358:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851248.565376:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851248.565380:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851248.565382:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851248.565385:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788851248.565742:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019797248:0@lo:400:kworker.0 00000100:00100000:0.0:1788851248.565814:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851248.565862:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019797760:0@lo:400:kworker.0 00000100:00100000:0.0:1788851248.565892:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851248.565923:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019797376:0@lo:400:kworker.0 00000100:00100000:1.0:1788851248.565954:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851248.566095:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019797632:0@lo:400:kworker.0 00000100:00100000:0.0:1788851248.567530:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019797248 00000100:00100000:0.0:1788851248.567543:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019797248 00000100:00100000:0.0:1788851248.567616:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788851248.567625:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:3648:x1875746019797248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851248.567697:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:3648:x1875746019797248:12345-0@lo:400:kworker.0 Request processed in 73us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851248.567720:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788851248.567782:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019797248:0@lo:400:kworker.0 00000100:00100000:1.0:1788851248.567969:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019797888:0@lo:400:kworker.0 00000100:00100000:1.0:1788851248.568032:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851248.568054:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788851248.568062:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019797504:0@lo:400:kworker.0 00000100:00100000:1.0:1788851248.568083:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851248.568101:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019798016:0@lo:400:kworker.0 00000100:00100000:1.0:1788851248.568124:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851248.568156:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019797760 00000100:00100000:1.0:1788851248.568161:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019797760 00000100:00100000:1.0:1788851248.568183:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019797888 00000100:00100000:1.0:1788851248.568186:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019797888 00000100:00100000:3.0:1788851248.568691:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851248.568777:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019797504 00000100:00100000:1.0:1788851248.568782:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019797504 00000100:00100000:1.0:1788851248.568796:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019798016 00000100:00100000:1.0:1788851248.568798:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019798016 00000100:00100000:1.0:1788851248.568814:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851248.568831:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019797760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851248.568883:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019797760:12345-0@lo:400:kworker.0 Request processed in 53us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851248.568890:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851248.568905:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851248.568911:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019797888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851248.568955:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019797888:12345-0@lo:400:kworker.0 Request processed in 43us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851248.568973:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788851248.572508:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e15180 x1875746019797888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851248.572529:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019797888:0@lo:400:kworker.0 00000100:00080000:2.0:1788851248.574766:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851248.574776:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851248.574807:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851248.574828:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019797504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851248.574935:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019797504:12345-0@lo:400:kworker.0 Request processed in 115us (6850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851248.574943:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851248.574990:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851248.575000:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019798016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851248.575052:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019798016:12345-0@lo:400:kworker.0 Request processed in 55us (6927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851248.575058:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851248.575084:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019797376 00000100:00100000:2.0:1788851248.575092:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019797376 00000100:00100000:2.0:1788851248.575125:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019797632 00000100:00100000:2.0:1788851248.575128:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019797632 00000100:00100000:2.0:1788851248.575140:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788851248.575146:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019797376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851248.575178:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019797376:12345-0@lo:400:kworker.0 Request processed in 32us (9224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851248.575185:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788851248.575197:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788851248.575737:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019797632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851248.575786:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019797632:12345-0@lo:400:kworker.0 Request processed in 582us (7096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851248.575792:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788851248.575924:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019797632:0@lo:400:kworker.0 00010000:00080000:3.0:1788851248.575976:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e16300 x1875746019797504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851248.576079:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019797504:0@lo:400:kworker.0 00010000:00080000:3.0:1788851248.576096:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e15f80 x1875746019798016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851248.576125:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019798016:0@lo:400:kworker.0 00000100:00100000:3.0:1788851248.576139:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019797376:0@lo:400:kworker.0 00010000:00080000:2.0:1788851248.585170:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e15500 x1875746019797760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851248.585199:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019797760:0@lo:400:kworker.0 00010000:00010000:0.0:1788851248.948787:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851249.076417:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851249.076439:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019798144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851249.076510:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851249.076556:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019798144 00000100:00100000:0.0:1788851249.076564:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019798144 00000100:00100000:0.0:1788851249.076610:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788851249.076619:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019798144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851249.076653:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788851249.076699:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019798144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851249.076706:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788851249.076732:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019798272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851249.076756:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851249.076800:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019798144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851249.078426:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019798272 00000100:00100000:2.0:1788851249.078436:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019798272 00000100:00100000:2.0:1788851249.078482:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788851249.078490:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019798272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851249.078516:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851249.079670:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019798272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1176us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851249.079681:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788851249.086504:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019798272:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851249.973146:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851250.940591:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788851250.996584:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788851251.665996:0:19082:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788851252.020132:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788851253.006414:0:19134:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851253.008240:0:19134:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788851253.050502:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851253.369347:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851238/real 1788851238] req@ffff892ea7d66680 x1875746019791616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851253.369374:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea7d66680 x1875746019791616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851253 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851253.369384:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851238/real 1788851238] req@ffff892ea7d66300 x1875746019791744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851253 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851253.369395:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea7d66300 x1875746019791744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851253 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788851253.369413:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eab226800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851253.369437:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788851253.369440:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019791616:0@lo:8:kworker.0 00000100:00080000:3.0:1788851253.369446:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851253.369451:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788851253.369454:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019791744:0@lo:8:kworker.0 00000100:00080000:2.0:1788851253.369650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851253.369655:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851253.369658:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851253.369660:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851253.369681:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851253.369685:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788851253.369687:0:8:0:(import.c:65:import_set_state_nolock()) ffff892eab226800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851253.369692:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 572 00000100:00080000:2.0:1788851253.369697:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788851253.369707:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff892eab226800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851253.369738:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c35500 x1875746019798912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851253.369753:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851253.369756:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788851253.369767:0:8:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851253.369770:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 572 00000100:00080000:2.0:1788851253.369773:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788851253.369779:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892ea4358800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851253.369794:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7c34a80 x1875746019799040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851253.369835:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019798528:0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.369913:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851253.369960:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019799296:0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.370205:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851253.370230:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788851253.370238:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019798400:0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.370264:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851253.370574:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019799168:0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.370598:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851253.370632:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019798656:0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.370655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851253.370673:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019799424:0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.370695:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851253.370713:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851253.370718:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019798784:0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.372508:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851253.372571:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019798912:0@lo:8:kworker.0 00000100:00100000:2.0:1788851253.372606:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851253.372643:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019799040:0@lo:8:kworker.0 00000100:00100000:2.0:1788851253.372685:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851253.372909:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019798912 00000100:00100000:0.0:1788851253.372917:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019798912 00000100:00100000:0.0:1788851253.372950:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019799040 00000100:00100000:0.0:1788851253.372953:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019799040 00000100:00100000:0.0:1788851253.373094:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851253.373102:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875746019798912:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788851253.373140:0:18720:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:0.0:1788851253.373169:0:18720:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b206cf4 00002000:00100000:0.0:1788851253.373183:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff892d81b69000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788851253.373187:0:18720:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788851253.373190:0:18720:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788851253.374634:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019798528 00000100:00100000:2.0:1788851253.374646:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019798528 00000100:00100000:2.0:1788851253.374712:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019798784 00000100:00100000:2.0:1788851253.374716:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019798784 00000100:00100000:2.0:1788851253.374747:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788851253.374755:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019798528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.374845:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019798528:12345-0@lo:400:kworker.0 Request processed in 90us (4932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851253.374853:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788851253.374884:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788851253.374891:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019798784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.374930:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019798784:12345-0@lo:400:kworker.0 Request processed in 39us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851253.374936:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788851253.374957:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019799296 00002000:00080000:0.0:1788851253.375451:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788851253.375486:0:18720:0:(import.c:65:import_set_state_nolock()) ffff892d81b6b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851253.375592:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019799296 00000100:00100000:2.0:1788851253.375633:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019799168 00000100:00100000:2.0:1788851253.375637:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019799168 00000100:00100000:2.0:1788851253.375649:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019798656 00000100:00100000:2.0:1788851253.375652:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019798656 00000100:00100000:2.0:1788851253.375663:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019799424 00000100:00100000:2.0:1788851253.375666:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019799424 00000100:00100000:2.0:1788851253.375681:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788851253.375688:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019799296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.375736:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019799296:12345-0@lo:400:kworker.0 Request processed in 36us (5518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851253.375744:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788851253.375770:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788851253.375776:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019799168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.375805:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019799168:12345-0@lo:400:kworker.0 Request processed in 29us (5206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851253.375810:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788851253.375821:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788851253.375827:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019798656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.375853:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019798656:12345-0@lo:400:kworker.0 Request processed in 27us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851253.375859:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788851253.375889:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788851253.375895:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019799424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.375922:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019799424:12345-0@lo:400:kworker.0 Request processed in 27us (5226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851253.375928:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788851253.375950:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019798400 00000100:00100000:2.0:1788851253.375955:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019798400 00000100:00100000:2.0:1788851253.375997:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788851253.376003:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:3650:x1875746019798400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.376055:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:3650:x1875746019798400:12345-0@lo:400:kworker.0 Request processed in 52us (5789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851253.376061:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788851253.376123:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019798400:0@lo:400:kworker.0 00010000:00080000:2.0:1788851253.376138:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c36d80 x1875746019799168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851253.376162:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019799168:0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.376176:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019798528:0@lo:400:kworker.0 00010000:00080000:2.0:1788851253.376186:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c36300 x1875746019799296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851253.376194:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019799296:0@lo:400:kworker.0 00000100:00100000:2.0:1788851253.376234:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019798784:0@lo:400:kworker.0 00010000:00080000:2.0:1788851253.376245:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c35180 x1875746019798656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851253.376254:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019798656:0@lo:400:kworker.0 00010000:00080000:2.0:1788851253.376263:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c35f80 x1875746019799424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851253.376271:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019799424:0@lo:400:kworker.0 00000100:00080000:2.0:1788851253.376297:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851253.376301:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851253.376934:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875746019798912:12345-0@lo:8:kworker.0 Request processed in 3827us (4322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851253.376945:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851253.376970:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851253.376975:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875746019799040:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788851253.376994:0:18720:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788851253.397926:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7c35500 x1875746019798912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851253.397942:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788851253.397964:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788851253.397974:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788851253.397980:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788851253.397985:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eab226800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788851253.398008:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788851253.398029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019798912:0@lo:8:kworker.0 00000004:00080000:3.0:1788851253.398194:0:17953:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788851253.398217:0:17953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1875746019799680:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788851253.398278:0:17953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851253.398309:0:17953:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e4eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851253.398325:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019799552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851253.398352:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851253.398400:0:18721:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788851253.398407:0:18721:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788851253.402587:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019799552 00000100:00100000:1.0:1788851253.402604:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019799552 00000100:00100000:1.0:1788851253.402675:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788851253.402686:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019799552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851253.402718:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851253.402822:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019799552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (4468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851253.402830:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1788851253.405826:0:17952:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788851253.405937:0:17952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 587464924160ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788851253.405946:0:17952:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:3.0:1788851253.408109:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788851253.408164:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5994380 x1875746019799552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851253.408191:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019799552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788851253.423210:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875746019799040:12345-0@lo:8:kworker.0 Request processed in 46225us (50517us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788851253.423225:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851253.423255:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019799680 00000100:00100000:0.0:1788851253.423263:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019799680 00000100:00080000:2.0:1788851253.425356:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851253.425370:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851253.425376:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019799040:0@lo:8:kworker.0 00000100:00100000:0.0:1788851253.429258:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851253.429280:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17953:x1875746019799680:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:2.0:1788851253.450541:0:18720:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788851253.450552:0:18720:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788851253.450655:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17953:x1875746019799680:12345-0@lo:7:osp-pre-0-1.0 Request processed in 21382us (52373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851253.450673:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:3.0:1788851253.455713:0:17944:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:3.0:1788851253.455791:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5995500 x1875746019799680/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788851269 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851253.455807:0:17953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1875746019799680:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788851253.455822:0:17953:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788851253.455875:0:17953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1875746019799808:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788851253.455945:0:17953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851253.455989:0:17953:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e4eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851253.456914:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019799808 00000100:00100000:1.0:1788851253.456934:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019799808 00000100:00100000:1.0:1788851253.456981:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851253.456991:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17953:x1875746019799808:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788851253.457579:0:18719:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788851253.457653:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17953:x1875746019799808:12345-0@lo:5:osp-pre-0-1.0 Request processed in 663us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851253.457809:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788851253.460497:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5995500 x1875746019799808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788851269 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851253.460517:0:17953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1875746019799808:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788851253.460533:0:17953:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788851253.460577:0:17953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1875746019799936:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788851253.460636:0:17953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851253.460667:0:17953:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e4eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851253.467834:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019799936 00000100:00100000:1.0:1788851253.467848:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019799936 00000100:00100000:1.0:1788851253.467930:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788851253.467941:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17953:x1875746019799936:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788851253.467984:0:18720:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1788851253.539816:0:18715:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788851253.539835:0:18715:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788851253.540476:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17953:x1875746019799936:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72532us (79834us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788851253.540489:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788851253.541540:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5995500 x1875746019799936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788851269 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851253.541556:0:17953:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788851253.541563:0:17953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17953:1875746019799936:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788851253.541580:0:17953:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788851253.541633:0:17953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17953:1875746019800064:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788851253.542566:0:17953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851253.542608:0:17953:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851253.542802:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019800064 00000100:00100000:0.0:1788851253.542810:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019800064 00000100:00100000:0.0:1788851253.542858:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851253.542886:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17953:x1875746019800064:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788851253.543334:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17953:x1875746019800064:12345-0@lo:900:osp-pre-0-1.0 Request processed in 450us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851253.543343:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788851253.543380:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e87c32300 x1875746019800064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788851269 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851253.543394:0:17953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17953:1875746019800064:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788851254.080393:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851254.196492:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019800192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851254.196573:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851254.196983:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019800192 00000100:00100000:3.0:1788851254.196992:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019800192 00000100:00100000:3.0:1788851254.197067:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788851254.197076:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019800192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851254.197128:0:18246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788851254.197183:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019800192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851254.197190:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788851254.197230:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019800320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851254.197258:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851254.197406:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019800320 00000100:00100000:0.0:1788851254.197411:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019800320 00000100:00100000:0.0:1788851254.197445:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788851254.197451:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019800320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851254.197481:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788851254.197517:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019800320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851254.197523:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788851254.197670:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019800192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851254.199481:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019800320:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788851254.435162:0:19185:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788851254.435386:0:19185:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788851255.092269:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851256.116191:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851257.147138:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851258.168991:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851258.488603:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788851258.808334:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851258.808341:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851258.808344:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851258.808346:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851258.808373:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851258.808377:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788851258.808380:0:8:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851258.808389:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 587 00000100:00080000:1.0:1788851258.808395:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788851258.808407:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892ea4358800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851258.808429:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e83e16a00 x1875746019801088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851258.808488:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019800704:0@lo:400:kworker.0 00000100:00100000:1.0:1788851258.808572:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851258.808624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019801344:0@lo:400:kworker.0 00000100:00100000:1.0:1788851258.808659:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851258.808689:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788851258.808695:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019800832:0@lo:400:kworker.0 00000100:00100000:1.0:1788851258.808778:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851258.808811:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019801472:0@lo:400:kworker.0 00000100:00100000:1.0:1788851258.808833:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851258.808868:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019800832 00000100:00100000:1.0:1788851258.808875:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019800832 00000100:00100000:1.0:1788851258.808918:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788851258.808927:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019800832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851258.808976:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019800832:12345-0@lo:400:kworker.0 Request processed in 49us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851258.808982:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788851258.809043:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019800832:0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.812384:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019800448:0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.812492:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851258.812555:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019800960:0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.812597:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851258.812642:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788851258.812662:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019800576:0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.812688:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851258.812708:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019801216:0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.812731:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851258.812796:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019800960 00000100:00100000:3.0:1788851258.812804:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019800960 00000100:00100000:3.0:1788851258.812857:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851258.812865:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019800960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.812918:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019800960:12345-0@lo:400:kworker.0 Request processed in 54us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851258.812925:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851258.812947:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019800576 00000100:00100000:3.0:1788851258.812950:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019800576 00000100:00100000:3.0:1788851258.812975:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788851258.812981:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019800576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.813045:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019800576:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851258.813051:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788851258.813068:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019800704 00000100:00100000:3.0:1788851258.813072:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019800704 00000100:00100000:3.0:1788851258.813089:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019801344 00000100:00100000:3.0:1788851258.813092:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019801344 00000100:00100000:3.0:1788851258.813106:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019801472 00000100:00100000:3.0:1788851258.813109:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019801472 00000100:00100000:3.0:1788851258.813120:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019801216 00000100:00100000:3.0:1788851258.813122:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019801216 00000100:00100000:3.0:1788851258.813133:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788851258.813138:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019800704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.813187:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019800704:12345-0@lo:400:kworker.0 Request processed in 49us (4617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851258.813194:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788851258.813206:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788851258.813211:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019801344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.813236:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019801344:12345-0@lo:400:kworker.0 Request processed in 25us (4589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851258.813241:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788851258.813252:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788851258.813256:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019801472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.813281:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019801472:12345-0@lo:400:kworker.0 Request processed in 25us (4447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851258.813286:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788851258.813295:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788851258.813300:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019801216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.813340:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019801216:12345-0@lo:400:kworker.0 Request processed in 40us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851258.813347:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788851258.813363:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788851258.813367:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851258.813369:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788851258.813403:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e17800 x1875746019801472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851258.813417:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019801472:0@lo:400:kworker.0 00010000:00080000:3.0:1788851258.813430:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e16300 x1875746019800704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851258.813445:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019800704:0@lo:400:kworker.0 00010000:00080000:3.0:1788851258.813458:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e16d80 x1875746019801344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851258.813465:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019801344:0@lo:400:kworker.0 00000100:00100000:3.0:1788851258.813498:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019800576:0@lo:400:kworker.0 00010000:00080000:3.0:1788851258.813507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e17b80 x1875746019801216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851258.813514:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019801216:0@lo:400:kworker.0 00010000:00080000:3.0:1788851258.813523:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e83e15180 x1875746019800960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851258.813532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019800960:0@lo:400:kworker.0 00000100:00100000:1.0:1788851258.815310:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019800448 00000100:00100000:1.0:1788851258.815322:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019800448 00000100:00100000:1.0:1788851258.815373:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788851258.815382:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+21:3647:x1875746019800448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851258.815451:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+21:3647:x1875746019800448:12345-0@lo:400:kworker.0 Request processed in 71us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851258.815458:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788851258.815698:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019801088:0@lo:8:kworker.0 00000100:00100000:2.0:1788851258.815738:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851258.816123:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851258.816134:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019801600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851258.816205:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851258.816257:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019800448:0@lo:400:kworker.0 00000100:00100000:1.0:1788851258.816330:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019801600 00000100:00100000:1.0:1788851258.816335:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019801600 00000100:00100000:1.0:1788851258.816369:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788851258.816391:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019801600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851258.816416:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851258.816460:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019801600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851258.816467:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788851258.816535:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e87c32300 x1875746019801600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851258.816554:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019801600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851258.817069:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019801088 00000100:00100000:2.0:1788851258.817075:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019801088 00000100:00100000:2.0:1788851258.817106:0:19145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788851258.817111:0:19145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875746019801088:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788851258.817129:0:19145:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788851258.830029:0:19145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875746019801088:12345-0@lo:8:kworker.0 Request processed in 12890us (14264us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788851258.830057:0:19145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788851258.830302:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851258.830309:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851258.830314:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019801088:0@lo:8:kworker.0 00010000:00010000:1.0:1788851259.188234:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851259.316222:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019801728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851259.316299:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851259.316399:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019801728 00000100:00100000:0.0:1788851259.316408:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019801728 00000100:00100000:0.0:1788851259.316463:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788851259.316472:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019801728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851259.316512:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788851259.316562:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019801728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851259.316569:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788851259.316658:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019801728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851259.316998:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851259.317033:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019801856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851259.317069:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851259.317151:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019801856 00000100:00100000:3.0:1788851259.317156:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019801856 00000100:00100000:3.0:1788851259.317192:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851259.317198:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019801856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851259.317217:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788851259.317255:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019801856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851259.317261:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851259.317292:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019801856:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788851260.154250:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788851260.212374:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851260.852602:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851240/real 1788851240] req@ffff892ea5996680 x1875746019792128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851260 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851260.852634:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea5996680 x1875746019792128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851260 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851260.852644:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851240/real 1788851240] req@ffff892ea5995c00 x1875746019792256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851260 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851260.852665:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea5995c00 x1875746019792256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851260 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788851260.852686:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5769000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851260.852711:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788851260.852715:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019792128:0@lo:8:kworker.0 00000100:00080000:2.0:1788851260.852736:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851260.852742:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788851260.852745:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019792256:0@lo:8:kworker.0 00000100:00080000:0.0:1788851260.852915:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851260.852935:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788851260.852937:0:37:0:(import.c:65:import_set_state_nolock()) ffff892ea5769000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851260.852942:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 574 00000100:00080000:0.0:1788851260.852947:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788851260.852959:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff892ea5769000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851260.852982:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7d65c00 x1875746019802240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851260.852997:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851260.853000:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788851260.853001:0:37:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851260.853004:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 574 00000100:00080000:0.0:1788851260.853006:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788851260.853039:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892e88540000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851260.853052:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7d65880 x1875746019802368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851260.853078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851260.853082:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788851260.853083:0:37:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851260.853086:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 592 00000100:00080000:0.0:1788851260.853088:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788851260.853093:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892ea4358800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851260.853105:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7d67100 x1875746019802880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788851260.853144:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019802240:0@lo:8:kworker.0 00000100:00100000:0.0:1788851260.853217:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851260.853253:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019802368:0@lo:8:kworker.0 00000100:00100000:0.0:1788851260.853277:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851260.853291:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019802880:0@lo:8:kworker.0 00000100:00100000:0.0:1788851260.853312:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851260.853446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019802624:0@lo:400:kworker.0 00000100:00100000:1.0:1788851260.853478:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851260.853511:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019803264:0@lo:400:kworker.0 00000100:00100000:1.0:1788851260.853535:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851260.853553:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788851260.853559:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019801984:0@lo:400:kworker.0 00000100:00100000:1.0:1788851260.853587:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851260.853605:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019802752:0@lo:400:kworker.0 00000100:00100000:1.0:1788851260.853625:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851260.853653:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019801984 00000100:00100000:1.0:1788851260.853660:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019801984 00000100:00100000:1.0:1788851260.853704:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788851260.853714:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:3649:x1875746019801984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851260.853781:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:3649:x1875746019801984:12345-0@lo:400:kworker.0 Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851260.853789:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788851260.853838:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019801984:0@lo:400:kworker.0 00000100:00100000:0.0:1788851260.853951:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019802624 00000100:00100000:0.0:1788851260.853956:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019802624 00000100:00100000:0.0:1788851260.853995:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788851260.854002:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019802624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851260.854068:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019802624:12345-0@lo:400:kworker.0 Request processed in 66us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851260.854075:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788851260.854104:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019802624:0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.854185:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019802496:0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.854216:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851260.854249:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019803136:0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.854270:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851260.854289:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788851260.854295:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019802112:0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.854316:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851260.854335:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019803008:0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.854355:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851260.854381:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019802240 00000100:00100000:3.0:1788851260.854385:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019802240 00000100:00100000:3.0:1788851260.854401:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019802368 00000100:00100000:3.0:1788851260.854412:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019802368 00000100:00100000:3.0:1788851260.854425:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019802880 00000100:00100000:3.0:1788851260.854428:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019802880 00000100:00100000:3.0:1788851260.854436:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019802752 00000100:00100000:3.0:1788851260.854438:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019802752 00000100:00100000:3.0:1788851260.854467:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851260.854473:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019802752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.854513:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019802752:12345-0@lo:400:kworker.0 Request processed in 40us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851260.854519:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851260.854534:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851260.854538:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019802240:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788851260.854563:0:18719:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:3.0:1788851260.854594:0:18719:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b206cfb 00002000:00100000:3.0:1788851260.854609:0:18719:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff892eacd5c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788851260.854613:0:18719:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788851260.854616:0:18719:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788851260.854692:0:18719:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788851260.854715:0:18719:0:(import.c:65:import_set_state_nolock()) ffff892eacd5b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851260.854780:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875746019802240:12345-0@lo:8:kworker.0 Request processed in 240us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851260.854787:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851260.854801:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851260.854805:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019802368:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788851260.854817:0:18719:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788851260.854844:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019802368:12345-0@lo:8:kworker.0 Request processed in 37us (1566us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788851260.854856:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851260.854868:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851260.854872:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019802880:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788851260.854882:0:18719:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788851260.854908:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019802880:12345-0@lo:8:kworker.0 Request processed in 35us (1595us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788851260.854914:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851260.854939:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019803264 00000100:00100000:3.0:1788851260.854942:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019803264 00000100:00100000:3.0:1788851260.854963:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019802496 00000100:00100000:3.0:1788851260.854965:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019802496 00000100:00100000:3.0:1788851260.854976:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019803136 00000100:00100000:3.0:1788851260.854978:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019803136 00000100:00100000:3.0:1788851260.854989:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019803008 00000100:00100000:3.0:1788851260.854992:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019803008 00000100:00100000:3.0:1788851260.855004:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788851260.855045:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019803264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.855078:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019803264:12345-0@lo:400:kworker.0 Request processed in 68us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851260.855085:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788851260.855098:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788851260.855103:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019802496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.855136:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019802496:12345-0@lo:400:kworker.0 Request processed in 33us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851260.855142:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788851260.855154:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788851260.855160:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019803136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.855196:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019803136:12345-0@lo:400:kworker.0 Request processed in 36us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851260.855203:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788851260.855215:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851260.855221:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019803008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.855249:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019803008:12345-0@lo:400:kworker.0 Request processed in 28us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851260.855255:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851260.855282:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019802112 00000100:00100000:3.0:1788851260.855285:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019802112 00000100:00100000:3.0:1788851260.855312:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788851260.855318:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019802112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851260.855349:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019802112:12345-0@lo:400:kworker.0 Request processed in 31us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851260.855355:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788851260.855374:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851260.855386:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788851260.855388:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851260.855416:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019802112:0@lo:400:kworker.0 00010000:00080000:3.0:1788851260.855428:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7d66300 x1875746019803008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851260.855439:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019803008:0@lo:400:kworker.0 00010000:00080000:3.0:1788851260.855449:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7d65180 x1875746019802496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851260.855457:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019802496:0@lo:400:kworker.0 00010000:00080000:3.0:1788851260.855476:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7d66680 x1875746019803136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851260.855484:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019803136:0@lo:400:kworker.0 00010000:00080000:3.0:1788851260.855518:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7d65500 x1875746019802752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851260.855527:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019802752:0@lo:400:kworker.0 00010000:00080000:3.0:1788851260.855537:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7d64a80 x1875746019803264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851260.855545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019803264:0@lo:400:kworker.0 00010000:00080000:3.0:1788851260.855571:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7d65c00 x1875746019802240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851260.855579:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788851260.855585:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788851260.855593:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788851260.855598:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788851260.855600:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5769000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788851260.855612:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788851260.855617:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019802240:0@lo:8:kworker.0 00000100:00080000:3.0:1788851260.855629:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851260.855633:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788851260.855635:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019802368:0@lo:8:kworker.0 00000100:00080000:3.0:1788851260.855648:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851260.855651:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788851260.855660:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019802880:0@lo:8:kworker.0 00000004:00080000:0.0:1788851260.855825:0:17236:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788851260.855902:0:17236:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 594914888231ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788851260.855907:0:17236:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788851260.856208:0:17237:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788851260.856268:0:17237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17237:1875746019803520:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788851260.856309:0:17237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851260.856330:0:17237:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851260.856386:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851260.856395:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019803392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851260.856432:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851260.856547:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019803392 00000100:00100000:2.0:1788851260.856560:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019803392 00000100:00080000:0.0:1788851260.856655:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851260.856691:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851260.856699:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019803392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851260.856734:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788851260.856787:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019803392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851260.856794:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788851260.856906:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e87c33100 x1875746019803392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851260.856922:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019803392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851260.857183:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019803520 00000100:00100000:3.0:1788851260.857188:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019803520 00000100:00100000:3.0:1788851260.857212:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788851260.857218:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17237:x1875746019803520:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788851260.860560:0:18719:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788851260.860572:0:18719:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788851260.860577:0:18719:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:0.0:1788851260.862270:0:17192:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788851260.868714:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.868738:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.868765:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.868770:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.868777:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.868796:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.868806:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.868814:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.868841:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851260.869380:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.869386:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869395:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.869398:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.869402:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869410:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869418:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869425:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869441:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788851260.869450:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851260.869455:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869463:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851260.869468:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869488:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869506:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869514:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b6ca251/0x3e0030720b206d02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869532:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851260.869536:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869543:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851260.869546:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869554:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869563:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869569:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097128cc5/0x3e0030720b206d09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.869592:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.869594:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.869596:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.869774:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851260.870843:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.870852:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.870865:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.870868:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.870873:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.870884:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.870893:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.870900:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.870923:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851260.871001:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.871008:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.871032:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.871036:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.871046:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.871066:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.871074:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006731e985/0x3e0030720b206d10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.871090:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.871092:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.871094:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851260.871628:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.871635:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.872250:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.872254:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.872260:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.872274:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.872285:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.872293:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.872315:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851260.872412:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851260.872420:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.872440:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851260.872444:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.872452:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.872470:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.872478:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2145af9/0x3e0030720b206d17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.872502:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.872504:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.872506:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851260.872933:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.872939:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.872948:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.872952:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.872956:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.872966:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.872986:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.872992:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.873161:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851260.873497:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.873503:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.873511:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.873514:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.873517:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.873526:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.873533:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.873540:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873583:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851260.873589:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873597:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.873600:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873614:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873629:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873636:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bac61e9/0x3e0030720b206d1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873662:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.873665:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873672:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.873675:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873682:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873690:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.873696:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.873698:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.873705:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.873839:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851260.873844:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008498bd1f/0x3e0030720b206d25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851260.874250:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.874256:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.874264:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.874267:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.874271:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.874279:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.874286:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.874292:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.874341:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851260.874611:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.874617:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.874632:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.874635:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.874638:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.874647:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.874667:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.874675:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874755:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851260.874761:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874768:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433de00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.874771:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874779:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874793:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874800:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b206d2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874813:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.874816:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874822:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.874825:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874831:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874846:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.874853:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.874855:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.874856:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.874909:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.874940:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851260.874945:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.876359:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851260.877811:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.877828:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.877845:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.877850:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.877856:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.877886:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.877897:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.877904:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.877925:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851260.878652:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.878671:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.878679:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.878684:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.878694:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.878714:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.878731:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030391f55/0x3e0030720b206d3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.878762:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.878763:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.878772:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851260.878979:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.878987:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.878996:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.879031:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.879037:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.879047:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.879055:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.879074:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.879090:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851260.879384:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.879390:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.879399:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.879403:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.879412:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.879425:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.879431:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f184cef5/0x3e0030720b206d41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.879445:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.879446:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.879448:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851260.879518:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.879524:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.879533:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.879536:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.879540:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.879548:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.879555:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.879561:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.879854:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851260.880876:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.880884:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.880903:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.880906:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.880911:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.880923:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.880933:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.880941:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881463:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851260.881472:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881481:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.881485:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881505:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881521:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881529:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006432314d/0x3e0030720b206d48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881550:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.881553:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881558:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.881561:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881568:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881576:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.881583:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.881584:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.881591:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.881798:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851260.881804:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851260.885750:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.885763:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.885780:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.885784:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.885789:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.885815:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.885826:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.885834:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.886214:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.886223:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.886232:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.886236:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.886247:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.886267:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.886278:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.886280:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.886282:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.886332:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851260.886337:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851260.886909:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.886916:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.886926:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.886929:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.886934:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.886945:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.886965:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.886972:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.886987:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851260.887344:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.887352:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.887362:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.887366:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.887375:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.887402:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.887410:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13086bd/0x3e0030720b206d5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.887425:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.887427:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.887428:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.887436:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851260.887502:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.887507:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.887515:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.887518:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.887521:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.887530:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.887908:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.887915:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.887945:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851260.889864:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.889880:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.889894:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bda00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.889899:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.889909:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.889929:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.889937:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d5a6e1/0x3e0030720b206d64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.889972:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.889974:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.889976:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851260.890228:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.890236:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.890246:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.890250:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.890255:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.890266:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.890275:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.890283:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.890815:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788851260.891940:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.891950:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.891964:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.891974:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.891980:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.891994:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.892027:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.892036:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.892985:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851260.892993:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.896436:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bce00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.896443:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.896460:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.896482:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.896490:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e33313b/0x3e0030720b206d6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.897109:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.897117:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.897126:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.897140:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.897149:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.897163:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.897172:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.897173:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.897177:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.899503:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851260.899520:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851260.903261:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.903277:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.903297:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.903302:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.903308:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.903324:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.903346:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.903354:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.903442:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.903449:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.903457:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.903461:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.903471:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.903486:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.905096:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.905102:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.905105:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.908350:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851260.908365:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206d79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851260.910993:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.911147:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.911165:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.911170:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.911176:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.911192:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.911202:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.911231:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.912989:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851260.913039:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.913051:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851260.913056:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.913069:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.913091:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.913103:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.913105:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.913107:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.917976:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851260.917993:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206d80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.919798:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851260.920953:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.920965:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.920982:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.920987:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.920993:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.921055:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.921067:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.921076:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.921093:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851260.921484:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851260.921493:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.921502:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851260.921507:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.921517:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.921539:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.921547:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca6c491/0x3e0030720b206d87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.921569:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.921577:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.921579:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851260.921805:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.921811:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.921820:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.921823:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.921827:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.921837:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.921845:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.921864:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.921888:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851260.922285:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851260.922291:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.922300:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851260.922304:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.922312:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.922326:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.922334:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e334ad84/0x3e0030720b206d8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.922349:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.922351:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.922353:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851260.922453:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851260.922460:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.922469:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788851260.922473:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851260.922477:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.922487:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.922496:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.922503:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.922559:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788851260.924240:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.924251:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.924266:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.924269:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.924275:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.924287:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.924298:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.924305:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.925997:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788851260.926031:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.926043:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433cc00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851260.926047:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.926067:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.926089:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.926096:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b206d95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.926117:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851260.926121:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.926127:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851260.926130:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.926138:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.926146:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.926153:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.926154:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.926161:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.927254:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851260.927265:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002674d36b/0x3e0030720b206d9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851260.928388:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.928398:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.928411:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.928415:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.928421:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.928433:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.928444:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.928451:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.932105:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851260.932121:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.932146:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851260.932151:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.932163:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.932184:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.932194:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.932196:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.932198:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.932422:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851260.932430:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e12f9f7/0x3e0030720b206da3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851260.933357:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851260.933365:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.933378:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=594s v=(0 0) 00010000:00010000:0.0:1788851260.933383:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851260.933389:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.933402:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.933411:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851260.933419:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.933907:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851260.933915:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.933924:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851260.933928:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.933936:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.933951:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.933960:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.933961:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851260.933963:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851260.936347:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851260.936361:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d7e08a3/0x3e0030720b206daa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851260.937225:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851260.937235:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.937248:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=594s v=(0 0) 00010000:00010000:1.0:1788851260.937253:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851260.937259:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.937272:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.937296:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.937304:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.937377:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851260.937385:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.937392:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bdc00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851260.937396:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.937405:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.937422:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.937453:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.937455:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.937457:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851260.938263:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788851260.938271:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008136b2ee/0x3e0030720b206db1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851260.939544:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851260.939855:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851260.939864:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.939877:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=594s v=(0 0) 00010000:00010000:1.0:1788851260.939882:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851260.939888:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.939902:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.939912:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.939932:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851260.939985:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788851260.940266:0:18719:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1788851260.940403:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17237:x1875746019803520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 83180us (84088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851260.940414:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788851260.940493:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851260.940500:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.940509:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851260.940513:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.940523:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.940543:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.940550:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075bbb72c/0x3e0030720b206db8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851260.940568:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.940569:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851260.940571:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851260.940648:0:17237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17237:1875746019803520:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788851260.940741:0:17237:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788851260.940852:0:17237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17237:1875746019803648:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788851260.940888:0:17237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851260.940949:0:17237:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58abd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851260.940986:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019803648 00000100:00100000:3.0:1788851260.940994:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019803648 00000100:00100000:3.0:1788851260.941275:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851260.941294:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17237:x1875746019803648:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788851260.941329:0:18720:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1788851260.954304:0:18715:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788851260.954353:0:18715:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788851260.961509:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17237:x1875746019803648:12345-0@lo:5:osp-pre-0-0.0 Request processed in 20206us (20608us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788851260.961531:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851260.963904:0:17237:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788851260.963918:0:17237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17237:1875746019803648:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788851260.963936:0:17237:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1788851261.238777:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851262.267764:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788851262.712148:0:19530:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788851262.712152:0:19530:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788851262.712154:0:19530:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788851262.712379:0:19530:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892d875ec800 00000020:01000004:2.0:1788851262.712397:0:19530:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788851262.712413:0:19530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788851262.712433:0:19530:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff892d85c64d40) 00000020:00000080:2.0:1788851262.712451:0:19530:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788851262.816122:0:19530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788851262.817805:0:19530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788851262.818602:0:19530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788851262.822431:0:19530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788851262.823043:0:19530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788851262.823800:0:19530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788851262.824417:0:19530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788851262.829331:0:19530:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788851262.829530:0:19530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788851262.829545:0:19530:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788851262.829555:0:19530:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e0030720b206dc6 00000020:01000004:3.0:1788851262.829563:0:19530:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788851262.829584:0:19530:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788851262.829587:0:19530:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788851262.829594:0:19530:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788851262.829630:0:19530:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788851262.829634:0:19530:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788851262.863124:0:19530:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788851262.863171:0:19530:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788851262.863176:0:19530:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788851262.863183:0:19530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788851262.863184:0:19530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851262.863185:0:19530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851262.863186:0:19530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851262.863187:0:19530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851262.863189:0:19530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788851262.863191:0:19530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851262.863192:0:19530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788851262.863196:0:19530:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788851262.863198:0:19530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788851262.863199:0:19530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788851262.863200:0:19530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851262.863201:0:19530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851262.863202:0:19530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851262.863203:0:19530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851262.863204:0:19530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788851262.863205:0:19530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851262.863206:0:19530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788851262.863235:0:19530:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788851262.863343:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019803776:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788851262.863422:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851262.863499:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d888659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851262.868239:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019803776 00000100:00100000:3.0:1788851262.868270:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019803776 00000100:00100000:3.0:1788851262.868334:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788851262.868345:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:19530:x1875746019803776:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788851262.868423:0:17205:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788851262.868427:0:17205:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788851262.868431:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788851262.869004:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:19530:x1875746019803776:12345-0@lo:253:mount.lustre.0 Request processed in 657us (5577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851262.869046:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788851262.869405:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019803776:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788851262.869422:0:19530:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788851262.869425:0:19530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788851262.869427:0:19530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788851262.869428:0:19530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851262.869430:0:19530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851262.869431:0:19530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851262.869432:0:19530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851262.869434:0:19530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788851262.869436:0:19530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851262.869437:0:19530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788851262.869459:0:19530:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892d875ec800 from lustre-OST0001 10000000:01000000:0.0:1788851262.869487:0:19530:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788851262.869490:0:19530:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788851262.869498:0:19530:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff892d85f23380 local copy 00010000:00010000:0.0:1788851262.869517:0:19530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851262.869638:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019803904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851262.869678:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851262.869732:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d88865d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851262.869758:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019803904 00000100:00100000:1.0:1788851262.869764:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019803904 00000100:00100000:1.0:1788851262.869812:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788851262.869821:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+21:19530:x1875746019803904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851262.869898:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+21:19530:x1875746019803904:12345-0@lo:501:mount.lustre.0 Request processed in 79us (219us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851262.869905:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788851262.869982:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019803904:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788851262.869994:0:19530:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788851262.870029:0:19530:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788851262.870035:0:19530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851262.870044:0:19530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851262.870073:0:19530:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892d875ec800 10000000:01000000:0.0:1788851262.870078:0:19530:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788851262.870083:0:19530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788851262.870086:0:19530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788851262.870090:0:19530:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788851262.870093:0:19530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788851262.870127:0:19530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851262.870136:0:19530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851262.870145:0:19530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851262.870171:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851262.870197:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851262.870234:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d88865d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851262.870557:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019804032 00000100:00100000:2.0:1788851262.870563:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019804032 00000100:00100000:2.0:1788851262.870601:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788851262.870609:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:19530:x1875746019804032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851262.870618:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851262.870630:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e7400/0x3e0030720b206dd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206dcd expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851262.870665:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e7400/0x3e0030720b206dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206dcd expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851262.870677:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e7400/0x3e0030720b206dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206dcd expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851262.870695:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7400, rc 0) 00000100:00100000:2.0:1788851262.870737:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804032:12345-0@lo:101:mount.lustre.0 Request processed in 129us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851262.870743:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788851262.870860:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851262.870873:0:19530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851262.870882:0:19530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851262.873213:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788851262.885328:0:19530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851262.891068:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788851262.891124:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788851262.891136:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788851262.891148:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788851262.891158:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788851262.891167:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788851262.891190:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788851262.891195:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788851262.891311:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851262.897427:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851262.897583:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d88865300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851262.897595:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019804160 00000100:00100000:3.0:1788851262.897609:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019804160 00000100:00100000:3.0:1788851262.897678:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788851262.897696:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851262.898078:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804160:12345-0@lo:501:mount.lustre.0 Request processed in 383us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851262.898086:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788851262.898182:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851262.898235:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851262.898304:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851262.898336:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ca4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788851262.898387:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019804288 00000100:00100000:2.0:1788851262.898392:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019804288 00000100:00100000:2.0:1788851262.898433:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788851262.898441:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851262.899425:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804288:12345-0@lo:503:mount.lustre.0 Request processed in 982us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851262.899434:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788851262.906456:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804288:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788851262.907163:0:19530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788851262.907365:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851262.907441:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851262.907624:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ca4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788851262.912366:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019804416 00000100:00100000:2.0:1788851262.912384:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019804416 00000100:00100000:2.0:1788851262.912452:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788851262.912463:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851262.913200:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804416:12345-0@lo:502:mount.lustre.0 Request processed in 736us (5756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851262.913210:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788851262.913380:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851262.913636:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788851262.913669:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788851262.913698:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788851262.913726:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788851262.913740:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788851262.913752:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788851262.913765:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788851262.913777:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788851262.913790:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788851262.913826:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851262.913996:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851262.914057:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d85ed03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851262.914132:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019804544 00000100:00100000:1.0:1788851262.914139:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019804544 00000100:00100000:1.0:1788851262.914180:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788851262.914189:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851262.914296:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804544:12345-0@lo:502:mount.lustre.0 Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851262.914303:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788851262.914897:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851262.914962:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788851262.914975:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788851262.918515:0:19534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788851262.918525:0:19534:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788851262.918540:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851262.918543:0:19534:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788851262.918549:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851262.918565:0:19534:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff892e83e399c0) 00000020:00000080:0.0:1788851262.918590:0:19534:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788851262.918595:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788851262.918678:0:19534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892d875ec800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788851262.918697:0:19534:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788851262.918704:0:19534:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e0030720b206de2 00010000:00010000:3.0:1788851262.931308:0:19534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788851262.932911:0:19534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788851262.935474:0:19534:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788851262.940264:0:19534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788851262.940278:0:19534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851262.940285:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851262.940287:0:19534:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788851262.940290:0:19534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851262.940294:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851262.940295:0:19534:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788851262.940297:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788851262.940299:0:19534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788851262.940301:0:19534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851262.940303:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851262.940304:0:19534:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788851262.940306:0:19534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851262.940308:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851262.940309:0:19534:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788851262.940313:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788851262.940353:0:19534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851262.940356:0:19534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851262.940357:0:19534:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788851262.940361:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788851262.940596:0:19530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788851262.940643:0:19530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788851262.940667:0:19530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851262.940690:0:19530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851262.940700:0:19530:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892d875ec800 from 1 10000000:01000000:1.0:1788851262.940703:0:19530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851262.940739:0:19530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851262.940748:0:19530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851262.940758:0:19530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851262.940782:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851262.940848:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851262.940897:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ca4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788851262.943227:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019804672 00000100:00100000:3.0:1788851262.943241:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019804672 00000100:00100000:3.0:1788851262.943304:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788851262.943315:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+22:19530:x1875746019804672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851262.943334:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851262.943363:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206de9 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851262.943392:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206de9 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851262.943418:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206de9 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851262.943427:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433da00, rc 0) 00000100:00100000:3.0:1788851262.943497:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019804672:12345-0@lo:101:mount.lustre.0 Request processed in 184us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851262.943503:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788851262.943839:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851262.943859:0:19530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851262.943869:0:19530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851262.948175:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788851262.948539:0:19530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851262.948783:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788851262.948819:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788851262.948833:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788851262.948838:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788851262.948911:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851262.948973:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851262.949063:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ca4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851262.950229:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019804800 00000100:00100000:3.0:1788851262.950242:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019804800 00000100:00100000:3.0:1788851262.950299:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788851262.950309:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019804800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851262.950471:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019804800:12345-0@lo:501:mount.lustre.0 Request processed in 163us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851262.950491:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788851262.950857:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851262.950902:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851262.950954:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851262.950990:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ca4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851262.952134:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019804928 00000100:00100000:3.0:1788851262.952145:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019804928 00000100:00100000:3.0:1788851262.952198:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788851262.952208:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019804928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851262.952646:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019804928:12345-0@lo:503:mount.lustre.0 Request processed in 438us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851262.952654:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788851262.953268:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019804928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788851262.954838:0:19530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788851262.954928:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851262.955004:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851262.956818:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87bee480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851262.966491:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019805056 00000100:00100000:0.0:1788851262.966510:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019805056 00000100:00100000:3.0:1788851262.968295:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788851262.968323:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019805056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851262.968545:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019805056:12345-0@lo:502:mount.lustre.0 Request processed in 236us (13540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851262.969495:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788851262.969774:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788851262.969809:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788851262.969824:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788851262.969840:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788851262.969854:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788851262.969867:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788851262.969879:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788851262.969891:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788851262.969905:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788851262.969919:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788851262.969933:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788851262.969973:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851262.972219:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851262.972293:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019805184 00000100:00100000:1.0:1788851262.972304:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019805184 00000100:00100000:3.0:1788851262.978033:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788851262.978088:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87bee480 going to sleep for 11 seconds 00000100:00100000:1.0:1788851262.979251:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788851262.979267:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019805184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851262.979472:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019805184:12345-0@lo:502:mount.lustre.0 Request processed in 211us (7261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851262.979480:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788851262.980759:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851262.980872:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788851262.980888:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788851262.984212:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851262.984230:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851262.984233:0:19538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788851262.984245:0:19538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892d875ec800 00000020:00000080:2.0:1788851262.984248:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851262.984257:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851262.984260:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851262.984261:0:19538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788851262.984264:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851262.984266:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851262.984267:0:19538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788851262.984270:0:19538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892d875ec800 00000020:00000080:2.0:1788851262.984272:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851262.985327:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851262.985336:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851262.985338:0:19538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788851262.985355:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851262.985359:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851262.985361:0:19538:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851262.985366:0:19538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892d875ec800 00000020:00000080:2.0:1788851262.985368:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851262.989274:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851262.989287:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851262.989289:0:19538:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851262.989294:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851262.989298:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851262.989299:0:19538:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788851262.989304:0:19538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892d875ec800 00000020:00000080:2.0:1788851262.989306:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851262.990529:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851262.990538:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851262.990541:0:19538:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788851262.990545:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788851262.992880:0:19530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788851262.992925:0:19530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851262.992947:0:19530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851262.992960:0:19530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851262.993048:0:19530:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788851262.993057:0:19530:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892d875ec800 10000000:01000000:1.0:1788851262.993062:0:19530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892d875ec800 10000000:01000000:1.0:1788851262.993065:0:19530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788851262.993071:0:19530:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892d875ec800 from 1 10000000:01000000:1.0:1788851262.993074:0:19530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788851262.993109:0:19530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851262.993117:0:19530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851262.993128:0:19530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851262.993152:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851262.993218:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851262.993259:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851262.996082:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019805312 00000100:00100000:0.0:1788851262.996101:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019805312 00000100:00100000:0.0:1788851262.996162:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788851262.996173:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+23:19530:x1875746019805312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851262.996191:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851263.004461:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea55bc000/0x3e0030720b206dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206df7 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851263.004507:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea55bc000/0x3e0030720b206dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206df7 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851263.004521:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea55bc000/0x3e0030720b206dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206df7 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851263.004531:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc000, rc 0) 00000100:00100000:0.0:1788851263.016090:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805312:12345-0@lo:101:mount.lustre.0 Request processed in 19907us (22859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851263.016103:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788851263.017531:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851263.017561:0:19530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.017576:0:19530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851263.019107:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788851263.019498:0:19530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851263.019760:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788851263.019788:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788851263.019802:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788851263.019831:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788851263.019856:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788851263.019869:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788851263.019881:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788851263.019893:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788851263.019906:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788851263.019920:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788851263.019932:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788851263.019943:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788851263.019954:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788851263.019966:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788851263.019979:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788851263.019992:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788851263.020006:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788851263.020739:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788851263.020759:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788851263.020790:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788851263.020807:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788851263.020821:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788851263.020835:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788851263.020849:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788851263.020863:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788851263.020875:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788851263.020888:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788851263.020901:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788851263.020916:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788851263.020927:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788851263.020940:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788851263.020951:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788851263.020963:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788851263.020975:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788851263.020989:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788851263.022101:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788851263.023135:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788851263.023172:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788851263.023186:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788851263.023199:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788851263.023210:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788851263.023221:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788851263.023232:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788851263.023244:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788851263.023260:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788851263.023275:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788851263.023303:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788851263.023308:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788851263.024912:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851263.024984:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851263.025106:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e98353180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851263.027220:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019805440 00000100:00100000:0.0:1788851263.027238:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019805440 00000100:00100000:0.0:1788851263.027312:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788851263.027322:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851263.027730:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805440:12345-0@lo:501:mount.lustre.0 Request processed in 409us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851263.027739:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788851263.027844:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851263.027919:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851263.027970:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851263.028043:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d88a38480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851263.028308:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019805568 00000100:00100000:3.0:1788851263.028314:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019805568 00000100:00100000:3.0:1788851263.028367:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788851263.028376:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851263.028480:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805568:12345-0@lo:503:mount.lustre.0 Request processed in 105us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851263.028487:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788851263.028651:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805568:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788851263.029397:0:19530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788851263.029500:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851263.029573:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851263.029621:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d88a38480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851263.029748:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019805696 00000100:00100000:3.0:1788851263.029755:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019805696 00000100:00100000:3.0:1788851263.029795:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788851263.029809:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851263.029920:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805696:12345-0@lo:502:mount.lustre.0 Request processed in 116us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851263.029929:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788851263.030237:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851263.030492:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788851263.030524:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788851263.030538:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788851263.030552:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788851263.030565:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788851263.030577:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788851263.030589:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788851263.030601:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788851263.030742:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788851263.030761:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788851263.030778:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788851263.030804:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788851263.030818:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788851263.030831:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788851263.030844:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788851263.030858:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788851263.030871:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788851263.030883:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788851263.030897:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788851263.030912:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788851263.030926:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788851263.030940:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788851263.030952:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788851263.030967:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788851263.030981:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788851263.030995:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788851263.031077:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788851263.031093:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788851263.031107:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788851263.031120:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788851263.031133:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788851263.031147:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788851263.031159:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788851263.031170:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788851263.031183:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788851263.031194:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788851263.031206:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788851263.031219:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788851263.031232:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788851263.031244:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788851263.031258:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788851263.031271:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788851263.031297:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788851263.031314:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788851263.033108:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788851263.033146:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788851263.033161:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788851263.033175:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788851263.033244:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851263.033339:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.033714:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788851263.033785:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019805824 00000100:00100000:0.0:1788851263.033793:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019805824 00000100:00100000:0.0:1788851263.033876:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788851263.033885:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851263.034060:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805824:12345-0@lo:502:mount.lustre.0 Request processed in 176us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851263.034069:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788851263.037002:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851263.037288:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788851263.037313:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788851263.037349:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851263.037418:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.037466:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788851263.037482:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019805952 00000100:00100000:2.0:1788851263.037495:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019805952 00000100:00100000:2.0:1788851263.037546:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788851263.037556:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851263.037677:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019805952:12345-0@lo:502:mount.lustre.0 Request processed in 121us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851263.038275:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788851263.038332:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019805952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851263.038395:0:19530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788851263.038407:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788851263.043250:0:19543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788851263.043275:0:19543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff892d85c619c0) 00000020:00000080:2.0:1788851263.043303:0:19543:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788851263.043785:0:19543:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892d875ec800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788851263.043791:0:19543:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892d875ec800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788851263.043794:0:19543:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892d875ec800 3 00010000:00080000:2.0:1788851263.043831:0:19543:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d81a65800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1788851263.048997:0:19543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788851263.049240:0:19543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788851263.049290:0:19543:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788851263.049305:0:19543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3e0030720b206e0c 00000100:00080000:2.0:1788851263.049314:0:19543:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788851263.049326:0:19543:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892d81a65800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851263.049363:0:19543:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c31f80 x1875746019806080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851263.049389:0:19543:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788851263.049445:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851263.049450:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788851263.049458:0:37:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851263.049462:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 594 00000100:00080000:2.0:1788851263.049465:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788851263.049470:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892e88540000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851263.049483:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c32a00 x1875746019806464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851263.049520:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851263.049523:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788851263.049524:0:37:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851263.049528:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 594 00000100:00080000:2.0:1788851263.049530:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788851263.049533:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892ea4358800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851263.049557:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c33100 x1875746019806976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851263.049602:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019806208:0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.055107:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019806080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788851263.066522:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.066595:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019806464:0@lo:8:kworker.0 00000100:00100000:3.0:1788851263.066655:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.066687:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019806976:0@lo:8:kworker.0 00000100:00100000:3.0:1788851263.066712:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851263.067738:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019806080 00000100:00100000:0.0:1788851263.067751:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019806080 00000100:00100000:0.0:1788851263.067799:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851263.067808:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019806080:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788851263.067839:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:0.0:1788851263.067880:0:17212:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e0030720b206e13 00000004:00100000:0.0:1788851263.067897:0:17212:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788851263.067931:0:17212:0:(import.c:65:import_set_state_nolock()) ffff892eb6993800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851263.068031:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875746019806080:12345-0@lo:38:llog_process_th.0 Request processed in 222us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851263.068040:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851263.068067:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019806464 00000100:00100000:0.0:1788851263.068072:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019806464 00000100:00100000:0.0:1788851263.068091:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019806976 00000100:00100000:0.0:1788851263.068094:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019806976 00000100:00100000:0.0:1788851263.068138:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788851263.068142:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875746019806464:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788851263.068187:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875746019806464:12345-0@lo:8:kworker.0 Request processed in 43us (1531us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788851263.068193:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788851263.068204:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788851263.068207:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875746019806976:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788851263.068233:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875746019806976:12345-0@lo:8:kworker.0 Request processed in 24us (1521us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788851263.068238:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788851263.068283:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e87c31f80 x1875746019806080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851263.068295:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788851263.068303:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788851263.068311:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788851263.068316:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788851263.068319:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d81a65800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788851263.068325:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019806080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788851263.068336:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788851263.071848:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851263.071864:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788851263.071872:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019806464:0@lo:8:kworker.0 00000100:00100000:0.0:1788851263.071911:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788851263.071918:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851263.071922:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788851263.071933:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019806976:0@lo:8:kworker.0 00000100:00100000:3.0:1788851263.072212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019806592:0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.072289:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.072330:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019807232:0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.072365:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.072386:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788851263.072393:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019806720:0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.072419:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.072450:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019807360:0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.072473:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.072499:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019806336:0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.072525:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.072541:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019807104:0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.072581:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.072632:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019806720 00000100:00100000:3.0:1788851263.072639:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019806720 00000100:00100000:3.0:1788851263.072697:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788851263.072706:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019806720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.072760:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019806720:12345-0@lo:400:kworker.0 Request processed in 56us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851263.072768:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788851263.072794:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019806592 00000100:00100000:3.0:1788851263.072798:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019806592 00000100:00100000:3.0:1788851263.072815:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019807232 00000100:00100000:3.0:1788851263.072817:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019807232 00000100:00100000:3.0:1788851263.072836:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019807360 00000100:00100000:3.0:1788851263.072838:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019807360 00000100:00100000:3.0:1788851263.072850:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019807104 00000100:00100000:3.0:1788851263.072852:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019807104 00000100:00100000:3.0:1788851263.072863:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788851263.072869:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019806592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.072915:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019806592:12345-0@lo:400:kworker.0 Request processed in 46us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851263.072921:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788851263.072932:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788851263.072938:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019807232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.072970:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019807232:12345-0@lo:400:kworker.0 Request processed in 33us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851263.072976:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788851263.072987:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788851263.072993:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019807360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.073044:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019807360:12345-0@lo:400:kworker.0 Request processed in 51us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851263.073050:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788851263.073061:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788851263.073067:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019807104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.073094:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019807104:12345-0@lo:400:kworker.0 Request processed in 28us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851263.073100:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788851263.073127:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e87c32300 x1875746019807104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851263.073140:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019807104:0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.073166:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019806720:0@lo:400:kworker.0 00010000:00080000:3.0:1788851263.073174:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5996680 x1875746019807360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851263.073181:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019807360:0@lo:400:kworker.0 00010000:00080000:3.0:1788851263.073190:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e87c30700 x1875746019806592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851263.073198:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019806592:0@lo:400:kworker.0 00010000:00080000:3.0:1788851263.073217:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea5995c00 x1875746019807232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851263.073225:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019807232:0@lo:400:kworker.0 00000100:00080000:0.0:1788851263.075585:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851263.075595:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851263.075612:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851263.075691:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019806336 00000100:00100000:2.0:1788851263.075700:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019806336 00000020:01000004:0.0:1788851263.075816:0:19543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788851263.075832:0:19543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff892e83e38000) 00000020:00000080:0.0:1788851263.075853:0:19543:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788851263.075956:0:19543:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892d875ec800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788851263.075960:0:19543:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892d875ec800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788851263.075963:0:19543:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892d875ec800 3 00010000:00080000:0.0:1788851263.075993:0:19543:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892eb6996000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.127@tcp at head 00000100:00100000:2.0:1788851263.076068:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851263.076081:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019806336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851263.076156:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019806336:12345-0@lo:400:kworker.0 Request processed in 79us (3630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851263.076165:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788851263.076201:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851263.076251:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019806336:0@lo:400:kworker.0 00000100:00100000:2.0:1788851263.076295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019806848:0@lo:400:kworker.0 00000100:00100000:2.0:1788851263.076333:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.076498:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019806208 00000100:00100000:3.0:1788851263.076504:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019806208 00000100:00100000:3.0:1788851263.076535:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788851263.076543:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019806208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851263.076584:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019806208:12345-0@lo:400:kworker.0 Request processed in 42us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851263.076591:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788851263.076715:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019806208:0@lo:400:kworker.0 00000100:00100000:1.0:1788851263.076741:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019806848 00000100:00100000:1.0:1788851263.076746:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019806848 00000100:00100000:1.0:1788851263.076787:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851263.076795:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019806848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851263.076834:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019806848:12345-0@lo:400:kworker.0 Request processed in 41us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851263.076840:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788851263.077058:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851263.077079:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019806848:0@lo:400:kworker.0 00010000:00010000:0.0:1788851263.085972:0:19543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788851263.087508:0:19543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788851263.087562:0:19543:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788851263.087575:0:19543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x3e0030720b206e21 00000100:00080000:0.0:1788851263.087587:0:19543:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851263.087599:0:19543:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff892eb6996000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851263.090574:0:19543:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c35880 x1875746019807488/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851263.093519:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019807488:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788851263.093600:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788851263.093714:0:19543:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788851263.095513:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019807488 00000100:00100000:3.0:1788851263.095530:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019807488 00000100:00100000:3.0:1788851263.095577:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851263.095587:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875746019807488:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788851263.095637:0:18245:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:3.0:1788851263.095691:0:18245:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x3e0030720b206e28 00000004:00100000:3.0:1788851263.095709:0:18245:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788851263.095747:0:18245:0:(import.c:65:import_set_state_nolock()) ffff892d815a9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851263.095830:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875746019807488:12345-0@lo:38:llog_process_th.0 Request processed in 243us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851263.095837:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788851263.095882:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e87c35880 x1875746019807488/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851263.095912:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788851263.095920:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788851263.095927:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788851263.095932:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788851263.095935:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eb6996000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788851263.095940:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019807488:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788851263.101796:0:19543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788851263.102002:0:19530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788851263.102061:0:19530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788851263.102080:0:19530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.102092:0:19530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788851263.102157:0:19530:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788851263.102160:0:19530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788851263.102161:0:19530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851263.102162:0:19530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851263.102164:0:19530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851263.102165:0:19530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851263.102166:0:19530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788851263.102168:0:19530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851263.102169:0:19530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851263.102173:0:19530:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788851263.102175:0:19530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788851263.102176:0:19530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788851263.102177:0:19530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851263.102178:0:19530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851263.102179:0:19530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851263.102180:0:19530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851263.102181:0:19530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788851263.102185:0:19530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851263.102186:0:19530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851263.102214:0:19530:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788851263.102233:0:19530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88283b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019807616:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788851263.102302:0:19530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.102472:0:19530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788851263.102724:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019807616 00000100:00100000:1.0:1788851263.102733:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019807616 00000100:00100000:1.0:1788851263.102777:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788851263.102786:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019807616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788851263.102812:0:17205:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788851263.102826:0:17205:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788851263.108215:0:17205:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788851263.108235:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788851263.108633:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:19530:x1875746019807616:12345-0@lo:253:mount.lustre.0 Request processed in 5843us (6325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851263.108654:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788851263.108797:0:19530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88283b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a8a82bd-f416-4736-bb65-b562856c988b:19530:1875746019807616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788851263.108810:0:19530:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788851263.108813:0:19530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788851263.108814:0:19530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788851263.108816:0:19530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851263.108817:0:19530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851263.108818:0:19530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851263.108819:0:19530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851263.108820:0:19530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851263.108821:0:19530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851263.108822:0:19530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788851263.108835:0:19530:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788851263.109887:0:17228:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788851263.109893:0:17228:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788851263.109914:0:17228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.109930:0:17228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206cd8 expref: 23 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.109938:0:17228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206ce6 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.109945:0:17228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.109979:0:17228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206ce6 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.109993:0:17228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206ce6 expref: 23 pid: 17206 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851263.110005:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88283800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019807744:0@lo:104: 00000100:00100000:3.0:1788851263.110065:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788851263.110105:0:17228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206cd8 expref: 23 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.110113:0:17228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206cd8 expref: 23 pid: 17207 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851263.110132:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88281c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019807872:0@lo:104: 00000100:00100000:3.0:1788851263.110151:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851263.110164:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788851263.112220:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019807744 00000100:00100000:1.0:1788851263.112237:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019807744 00000100:00100000:1.0:1788851263.112285:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019807872 00000100:00100000:1.0:1788851263.112288:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019807872 00000100:00100000:1.0:1788851263.112305:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788851263.112315:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+4:17228:x1875746019807744:12345-0@lo:104: 00010000:00010000:1.0:1788851263.112331:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112429:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788851263.112435:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+4:17228:x1875746019807744:12345-0@lo:104: Request processed in 122us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851263.112442:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788851263.112459:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851263.112465:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+3:17228:x1875746019807872:12345-0@lo:104: 00010000:00010000:1.0:1788851263.112473:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112507:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788851263.112512:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+3:17228:x1875746019807872:12345-0@lo:104: Request processed in 48us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851263.112517:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788851263.112538:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851263.112543:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112550:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851263.112566:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112574:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851263.112581:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851263.112588:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788851263.112623:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112630:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851263.112652:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112660:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea55bd200/0x3e0030720b206ce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206ced expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112674:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851263.112693:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112700:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851263.112703:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112711:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851263.112728:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851263.112734:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788851263.112750:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112756:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851263.112764:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112771:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892d876e7c00/0x3e0030720b206cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206cdf expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112787:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851263.112789:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851263.112791:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851263.112797:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851263.112817:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019808000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851263.112855:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851263.112888:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019808000 00000100:00100000:1.0:1788851263.112892:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019808000 00010000:00010000:1.0:1788851263.112912:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206ce6 expref: 24 pid: 17206 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851263.112937:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788851263.112944:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+24:3647:x1875746019808000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851263.112957:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851263.112968:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206ce6 expref: 24 pid: 17206 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.112981:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206ce6 expref: 24 pid: 17206 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113004:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851263.113054:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+24:3647:x1875746019808000:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851263.113060:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788851263.113093:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019808000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851263.113110:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851263.113115:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019808128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851263.113137:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851263.113160:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019808128 00000100:00100000:1.0:1788851263.113163:0:18367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019808128 00010000:00010000:1.0:1788851263.113175:0:18367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206cd8 expref: 24 pid: 17207 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851263.113195:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851263.113200:0:18367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a8a82bd-f416-4736-bb65-b562856c988b+24:3647:x1875746019808128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851263.113207:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851263.113211:0:18367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206cd8 expref: 24 pid: 17207 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113220:0:18367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206cd8 expref: 24 pid: 17207 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113233:0:18367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113249:0:18367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788851263.113265:0:18367:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003372499s 00010000:00010000:1.0:1788851263.113271:0:18367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113279:0:18367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113286:0:18367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113293:0:18367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113298:0:18367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433dc00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851263.113302:0:18367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113310:0:18367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113319:0:18367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851263.113327:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851263.113352:0:18367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a8a82bd-f416-4736-bb65-b562856c988b+24:3647:x1875746019808128:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851263.113358:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851263.113393:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019808128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851263.114295:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea55bd400/0x3e0030720b206ced lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206ce6 expref: 23 pid: 17206 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851263.114310:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88283800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019807744:0@lo:104: 00010000:00010000:3.0:1788851263.114321:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea55bc200/0x3e0030720b206cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206cd8 expref: 22 pid: 17207 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851263.114330:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88281c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17228:1875746019807872:0@lo:104: 00010000:00010000:3.0:1788851263.114358:0:17228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.114368:0:17228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.114375:0:17228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851263.114381:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433dc00/0x3e0030720b206e2f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788851263.129151:0:19530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788851263.131532:0:19530:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788851263.131541:0:19530:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788851263.131577:0:19530:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788851263.131634:0:19530:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788851263.131655:0:19530:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788851263.131686:0:19530:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788851263.132639:0:19530:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788851263.132861:0:19530:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788851263.284542:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851263.924347:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019808256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851263.924425:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851263.925612:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019808256 00000100:00100000:1.0:1788851263.925625:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019808256 00000100:00100000:1.0:1788851263.925686:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851263.925696:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019808256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851263.925735:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851263.925826:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019808256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851263.925833:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851263.925885:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019808256:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788851264.310700:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788851264.330441:0:19598:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788851264.330752:0:19598:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788851264.436856:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851264.436879:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019808384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851264.436957:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851264.437005:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019808384 00000100:00100000:1.0:1788851264.437025:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019808384 00000100:00100000:1.0:1788851264.437070:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788851264.437079:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019808384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851264.437114:0:18246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788851264.437161:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019808384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851264.437169:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788851264.437213:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019808384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851264.438953:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019808512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851264.439208:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851264.439345:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019808512 00000100:00100000:2.0:1788851264.439354:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019808512 00000100:00100000:2.0:1788851264.439402:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788851264.439410:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019808512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851264.439442:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851264.439588:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019808512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 178us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851264.439601:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788851264.439762:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019808512:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1788851264.629738:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851264.629764:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892eb6cf0800 from 10 10000000:01000000:0.0:1788851264.629769:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851264.629817:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.629829:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.629841:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851264.629864:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019808640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851264.629931:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851264.630072:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851264.632889:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019808640 00000100:00100000:3.0:1788851264.636908:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019808640 00000100:00100000:2.0:1788851264.638252:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788851264.638264:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+22:17209:x1875746019808640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851264.638282:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851264.638302:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6400/0x3e0030720b206e3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206e36 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851264.638331:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6400/0x3e0030720b206e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206e36 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851264.638342:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6400/0x3e0030720b206e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206e36 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851264.638352:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6400, rc 0) 00000100:00100000:2.0:1788851264.638427:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019808640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (8495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851264.638434:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788851264.638881:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019808640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851264.638901:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.638911:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851264.638982:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019808768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788851264.639052:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851264.639087:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851264.639149:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019808768 00000100:00100000:2.0:1788851264.639156:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019808768 00000100:00100000:2.0:1788851264.639192:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788851264.639200:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019808768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788851264.639214:0:17205:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788851264.639232:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788851264.639235:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788851264.639311:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019808768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851264.639318:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788851264.639473:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019808768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851264.639531:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851264.639538:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.639557:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851264.639567:0:17209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851264.639569:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892e84cde000 from 10 10000000:01000000:0.0:1788851264.639572:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851264.639604:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.639612:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.639620:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851264.639634:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019808896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851264.639672:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851264.639699:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851264.639713:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019808896 00000100:00100000:0.0:1788851264.639717:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019808896 00000100:00100000:0.0:1788851264.639738:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788851264.639744:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019808896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851264.639753:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851264.639763:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea55bdc00/0x3e0030720b206e4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206e44 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.639779:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea55bdc00/0x3e0030720b206e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206e44 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.639798:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea55bdc00/0x3e0030720b206e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206e44 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.639806:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bdc00, rc 0) 00000100:00100000:0.0:1788851264.639836:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:17209:x1875746019808896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851264.639843:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788851264.639871:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019808896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851264.639880:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.639888:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851264.639924:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019809024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788851264.639952:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851264.639965:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851264.639976:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019809024 00000100:00100000:0.0:1788851264.639979:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019809024 00000100:00100000:0.0:1788851264.639995:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788851264.640001:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:17209:x1875746019809024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788851264.640037:0:17206:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788851264.640049:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788851264.640052:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788851264.640119:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:17209:x1875746019809024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851264.640134:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788851264.640163:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019809024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851264.640201:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851264.640207:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851264.640215:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851265.334123:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851265.972709:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851265.972734:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019809152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851265.972808:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851265.978453:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019809152 00000100:00100000:2.0:1788851265.978471:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019809152 00000100:00100000:2.0:1788851265.978538:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788851265.978550:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019809152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851265.978582:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788851265.978682:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019809152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (5873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851265.978690:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788851265.978715:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851265.981290:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019809152:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788851266.356175:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851267.387395:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851268.409425:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788851268.532628:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851268.532636:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788851268.532640:0:36:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851268.532658:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892e88540000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851268.532683:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d88282680 x1875746019809664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851268.532715:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851268.532718:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788851268.532720:0:36:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851268.532725:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892ea4358800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851268.532734:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d88282d80 x1875746019810176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851268.532791:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019809408:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.532864:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.532924:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019810048:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.532950:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.532967:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019810688:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.532991:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533034:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788851268.533041:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019809280:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533072:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533110:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019809920:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533131:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533150:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019810560:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533169:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533194:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019809536:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533219:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533237:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019810304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533256:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533272:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019810816:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533288:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533303:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788851268.533308:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019809792:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533325:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533334:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019810432:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533351:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533367:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019809664:0@lo:8:kworker.0 00000100:00100000:3.0:1788851268.533386:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533401:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019810176:0@lo:8:kworker.0 00000100:00100000:3.0:1788851268.533418:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851268.533446:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019809408 00000100:00100000:3.0:1788851268.533453:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019809408 00000100:00100000:3.0:1788851268.533500:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019809920 00000100:00100000:3.0:1788851268.533503:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019809920 00000100:00100000:3.0:1788851268.533519:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788851268.533529:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019809408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533612:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019809408:12345-0@lo:400:kworker.0 Request processed in 83us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.533620:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788851268.533639:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788851268.533645:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019809920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533673:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019809920:12345-0@lo:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.533679:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788851268.533700:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019810048 00000100:00100000:3.0:1788851268.533704:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019810048 00000100:00100000:3.0:1788851268.533737:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019809536 00000100:00100000:3.0:1788851268.533740:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019809536 00000100:00100000:3.0:1788851268.533750:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019809664 00000100:00100000:3.0:1788851268.533753:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019809664 00000100:00100000:3.0:1788851268.533764:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019810176 00000100:00100000:3.0:1788851268.533767:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019810176 00000100:00100000:3.0:1788851268.533777:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851268.533782:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019810048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533830:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019810048:12345-0@lo:400:kworker.0 Request processed in 48us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.533837:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851268.533861:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851268.533867:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019809536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.533898:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019809536:12345-0@lo:400:kworker.0 Request processed in 32us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.533903:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851268.533914:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788851268.533925:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875746019809664:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788851268.533952:0:18720:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:3.0:1788851268.533985:0:18720:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b206e52 00002000:00100000:3.0:1788851268.534002:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff892d815a9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788851268.534006:0:18720:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788851268.534039:0:18720:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788851268.534261:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788851268.534286:0:18720:0:(import.c:65:import_set_state_nolock()) ffff892d815aa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851268.534327:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875746019809664:12345-0@lo:8:kworker.0 Request processed in 401us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.534334:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788851268.534346:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788851268.534350:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875746019810176:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788851268.534365:0:18720:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:3.0:1788851268.534379:0:18720:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b206e59 00002000:00100000:3.0:1788851268.534385:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff892d815ad000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788851268.534388:0:18720:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788851268.534390:0:18720:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788851268.534413:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788851268.534426:0:18720:0:(import.c:65:import_set_state_nolock()) ffff892d815ab800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851268.534453:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875746019810176:12345-0@lo:8:kworker.0 Request processed in 101us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.534459:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788851268.534490:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019810688 00000100:00100000:3.0:1788851268.534495:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019810688 00000100:00100000:3.0:1788851268.534519:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019810560 00000100:00100000:3.0:1788851268.534530:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019810560 00000100:00100000:3.0:1788851268.534547:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019810304 00000100:00100000:3.0:1788851268.534550:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019810304 00000100:00100000:3.0:1788851268.534559:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019810816 00000100:00100000:3.0:1788851268.534561:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019810816 00000100:00100000:3.0:1788851268.534585:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019809792 00000100:00100000:3.0:1788851268.534588:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019809792 00000100:00100000:3.0:1788851268.534602:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019810432 00000100:00100000:3.0:1788851268.534604:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019810432 00000100:00100000:3.0:1788851268.534617:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788851268.534623:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019810688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.534654:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019810688:12345-0@lo:400:kworker.0 Request processed in 32us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.534660:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788851268.534673:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788851268.534678:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019810560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.534701:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019810560:12345-0@lo:400:kworker.0 Request processed in 23us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.534706:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788851268.534717:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788851268.534722:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019810304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.534747:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019810304:12345-0@lo:400:kworker.0 Request processed in 25us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.534752:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788851268.534763:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788851268.534768:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019810816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.534793:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019810816:12345-0@lo:400:kworker.0 Request processed in 25us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.534808:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788851268.534820:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788851268.534825:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019809792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.534853:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019809792:12345-0@lo:400:kworker.0 Request processed in 28us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.534859:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788851268.534869:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788851268.534875:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019810432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.534901:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019810432:12345-0@lo:400:kworker.0 Request processed in 26us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.534906:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788851268.534940:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788851268.534944:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851268.534946:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788851268.534982:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88282680 x1875746019809664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788851268.534998:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788851268.535006:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788851268.535036:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788851268.535038:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788851268.535055:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788851268.535061:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019809664:0@lo:8:kworker.0 00010000:00080000:3.0:1788851268.535075:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88282d80 x1875746019810176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788851268.535084:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788851268.535095:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788851268.535098:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788851268.535100:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788851268.535119:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788851268.535123:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019810176:0@lo:8:kworker.0 00000004:00080000:3.0:1788851268.535151:0:17238:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788851268.535215:0:17238:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 602594201730ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788851268.535220:0:17238:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788851268.535406:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019809280 00000100:00100000:0.0:1788851268.535412:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019809280 00000100:00100000:0.0:1788851268.535446:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788851268.535452:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:3650:x1875746019809280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851268.535492:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:3650:x1875746019809280:12345-0@lo:400:kworker.0 Request processed in 41us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851268.535498:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000004:00080000:0.0:1788851268.535584:0:17239:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788851268.535602:0:17239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17239:1875746019811072:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788851268.535629:0:17239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851268.535655:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ec1c9de40 going to sleep for 11 seconds 00000004:00080000:0.0:1788851268.535688:0:17955:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788851268.535705:0:17955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1875746019811328:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788851268.535706:0:17954:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788851268.535732:0:17955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851268.535748:0:17955:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851268.535764:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019810944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851268.535796:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851268.535835:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019810944 00000004:00080000:2.0:1788851268.535838:0:17954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 602594824152ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788851268.535839:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019810944 00080000:00080000:2.0:1788851268.535846:0:17954:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788851268.535879:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851268.535886:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019810944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851268.535905:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788851268.535946:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019810944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851268.535954:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788851268.535975:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c35c00 x1875746019810944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851268.535979:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019811072 00000100:00100000:0.0:1788851268.535985:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019811072 00000100:00100000:2.0:1788851268.535997:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019810944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851268.536034:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019811328 00000100:00100000:0.0:1788851268.536039:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019811328 00000100:00100000:0.0:1788851268.537450:0:19145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788851268.537513:0:19145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17239:x1875746019811072:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788851268.537531:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788851268.537546:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17955:x1875746019811328:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:0.0:1788851268.538926:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851268.538952:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019811200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851268.539048:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788851268.539928:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88283480 x1875746019809792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851268.539946:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019809792:0@lo:400:kworker.0 00010000:00080000:3.0:1788851268.539963:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88280a80 x1875746019810432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851268.539972:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019810432:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.539985:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019809536:0@lo:400:kworker.0 00010000:00080000:3.0:1788851268.539998:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88281880 x1875746019810304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851268.540006:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019810304:0@lo:400:kworker.0 00010000:00080000:3.0:1788851268.540041:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88282300 x1875746019810816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851268.540049:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019810816:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.540115:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019809280:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.540126:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019809920:0@lo:400:kworker.0 00010000:00080000:3.0:1788851268.540149:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88280e00 x1875746019810560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851268.540157:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019810560:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.540167:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019809408:0@lo:400:kworker.0 00000100:00100000:3.0:1788851268.540583:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019810048:0@lo:400:kworker.0 00000100:00100000:2.0:1788851268.541058:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019811200 00000100:00100000:2.0:1788851268.541067:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019811200 00000100:00100000:2.0:1788851268.541116:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788851268.541126:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875746019811200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851268.541151:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788851268.541231:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875746019811200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851268.541239:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788851268.541284:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c34000 x1875746019811200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851268.541312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019811200:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788851268.542396:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88280380 x1875746019810688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851268.542409:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019810688:0@lo:400:kworker.0 00002000:00080000:0.0:1788851268.543168:0:19145:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788851268.543177:0:19145:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788851268.543183:0:19145:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:3.0:1788851268.543364:0:17192:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788851268.544290:0:17944:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788851268.548613:0:18721:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788851268.548628:0:18721:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788851268.549645:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17955:x1875746019811328:12345-0@lo:7:osp-pre-1-1.0 Request processed in 12093us (13901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.549660:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788851268.549673:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c33480 x1875746019811328/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788851284 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851268.549691:0:17955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1875746019811328:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788851268.549709:0:17955:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788851268.549758:0:17955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1875746019811456:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788851268.549810:0:17955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851268.549847:0:17955:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea7e71f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851268.550534:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019811456 00000100:00100000:3.0:1788851268.550543:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019811456 00000100:00100000:3.0:1788851268.550622:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788851268.550632:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17955:x1875746019811456:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788851268.550664:0:18719:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788851268.550725:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17955:x1875746019811456:12345-0@lo:5:osp-pre-1-1.0 Request processed in 95us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851268.550733:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788851268.550738:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c33480 x1875746019811456/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788851284 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851268.550752:0:17955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1875746019811456:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788851268.550766:0:17955:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788851268.550796:0:17955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1875746019811584:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788851268.550824:0:17955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851268.550848:0:17955:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea7e71f00 going to sleep for 11 seconds 00002000:00010000:0.0:1788851268.550873:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851268.550883:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.550906:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=602s v=(0 0) 00010000:00010000:0.0:1788851268.550911:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851268.550919:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.550941:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.550953:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.550962:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.550988:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851268.550999:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851268.551005:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551035:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851268.551040:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551051:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551070:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551078:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046bd7516/0x3e0030720b206e60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551095:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.551097:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.551100:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851268.551611:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851268.551619:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551630:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=602s v=(0 0) 00010000:00010000:0.0:1788851268.551638:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851268.551644:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551655:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551663:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551672:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551689:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851268.551699:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851268.551703:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551710:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851268.551713:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551722:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551733:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551752:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b072ba8/0x3e0030720b206e67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.551767:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.551769:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.551771:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851268.551988:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019811584 00000100:00100000:3.0:1788851268.551995:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019811584 00000100:00100000:3.0:1788851268.552064:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788851268.552082:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17955:x1875746019811584:12345-0@lo:5:osp-pre-1-1.0 00002000:00010000:0.0:1788851268.552090:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851268.552097:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552106:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=602s v=(0 0) 00010000:00010000:0.0:1788851268.552110:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851268.552115:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788851268.552120:0:18721:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:0.0:1788851268.552127:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552136:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552144:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552249:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851268.552257:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851268.552266:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552274:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851268.552277:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552286:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552298:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552305:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3523138/0x3e0030720b206e6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552319:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.552320:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.552322:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851268.552613:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851268.552621:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552630:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=602s v=(0 0) 00010000:00010000:0.0:1788851268.552633:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851268.552637:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552658:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552667:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552675:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552690:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851268.552697:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851268.552701:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552708:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851268.552711:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552719:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552730:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552737:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13086bd/0x3e0030720b206e75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.552758:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.552759:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.552761:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851268.553086:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851268.553093:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.553102:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=602s v=(0 0) 00010000:00010000:0.0:1788851268.553105:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851268.553109:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.553118:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.553127:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.553134:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.553215:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851268.553431:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.553438:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.553448:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebae00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.553451:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.553460:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851268.553460:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851268.553470:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.553481:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.553503:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab535c36/0x3e0030720b206e7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.553533:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.553535:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.553536:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.553560:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=602s v=(0 0) 00010000:00010000:0.0:1788851268.553565:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851268.553570:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.553590:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.553599:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.553606:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.553625:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788851268.554318:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851268.554325:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.554337:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=602s v=(0 0) 00010000:00010000:0.0:1788851268.554340:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851268.554345:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.554356:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.554377:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.554386:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.554411:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788851268.554494:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851268.554501:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554510:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebb000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.554521:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554531:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554545:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554552:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082445aa8/0x3e0030720b206e83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554569:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.554583:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554590:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebbc00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.554594:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554601:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554612:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554619:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096bb1cb2/0x3e0030720b206e8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.554639:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.554641:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.554643:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851268.554837:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851268.555954:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.555964:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.555978:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.555982:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.555988:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.556002:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.556038:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.556047:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.556065:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851268.556858:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.556869:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.556880:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.556886:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.556897:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.556918:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.556927:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206e91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.556948:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.556950:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.556951:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851268.557046:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851268.557054:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557063:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788851268.557067:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851268.557072:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557083:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557092:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557100:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557117:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851268.557426:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.557431:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.557451:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eb600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.557455:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.557464:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.557477:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.557486:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e45e217/0x3e0030720b206e98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.557502:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.557504:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.557506:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851268.557656:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851268.557662:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557671:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788851268.557674:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851268.557678:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557692:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557700:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557707:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.557725:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788851268.558370:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.558377:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.558395:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.558398:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.558402:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.558411:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.558418:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.558424:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.558477:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788851268.558598:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851268.558604:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558613:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851268.558617:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558626:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558697:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558705:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000423e2b/0x3e0030720b206e9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558727:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851268.558730:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558736:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851268.558739:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558747:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558757:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558763:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ea6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558774:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851268.558775:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851268.558777:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.558838:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851268.558960:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851268.558966:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558974:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788851268.558982:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851268.558987:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.558996:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.559004:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.559151:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.559394:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851268.559511:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851268.559517:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.559525:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851268.559528:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.559537:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.559560:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.559568:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008987ffa9/0x3e0030720b206ead lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.559714:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851268.559715:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.559716:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851268.559718:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851268.559720:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.559729:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788851268.559733:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851268.559738:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.559748:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.559756:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.559768:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.559789:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851268.559816:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851268.559822:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.559830:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eae00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851268.559834:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.559842:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.559855:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.559862:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004d7638f/0x3e0030720b206eb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.559876:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.559883:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.559884:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851268.560191:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851268.560197:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560206:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788851268.560209:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851268.560213:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560222:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560231:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560238:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560255:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851268.560355:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851268.560360:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.560368:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ebe00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851268.560372:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.560381:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.560394:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.560401:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000402bb0ed/0x3e0030720b206ebb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.560416:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.560417:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.560419:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851268.560674:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851268.560680:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560695:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788851268.560698:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851268.560702:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560711:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560721:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560729:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.560821:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788851268.561093:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851268.561099:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561107:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788851268.561110:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851268.561113:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561122:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561139:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561145:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561175:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788851268.561184:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851268.561188:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561195:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eb000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851268.561198:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561206:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561219:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561227:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b206ec2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561239:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851268.561248:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561255:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851268.561258:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561266:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561275:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561282:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000115795f3/0x3e0030720b206ec9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561293:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851268.561294:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851268.561296:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.561525:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851268.561688:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851268.561694:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561703:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788851268.561707:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851268.561711:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561730:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561739:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561746:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.561768:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851268.561882:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851268.561887:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.561895:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eb400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851268.561904:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.561912:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.561924:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.561932:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009caf4d3e/0x3e0030720b206ed0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851268.561945:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.561947:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851268.561949:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851268.562141:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851268.562146:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.562168:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788851268.562171:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851268.562175:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.562184:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.562192:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.562209:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851268.562226:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851268.562248:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851268.562254:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.562261:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851268.562265:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.562272:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.562285:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.562292:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8503e10/0x3e0030720b206ed7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.562317:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851268.562319:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851268.562321:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851268.566964:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.566979:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.566998:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.567003:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.567030:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567049:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567061:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567070:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567103:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851268.567130:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.567311:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567321:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.567327:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567348:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567366:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567374:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9dc93a3/0x3e0030720b206ede lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567394:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.567396:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.567398:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851268.567424:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.567430:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567451:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.567453:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.567457:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567466:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567474:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567480:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567499:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851268.567660:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.567666:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567674:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.567678:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567686:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567697:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567716:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d875da/0x3e0030720b206ee5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.567731:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.567732:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.567734:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851268.567901:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.567907:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567916:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.567919:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.567923:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567931:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567950:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567958:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.567973:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851268.568124:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.568130:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568147:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.568151:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568158:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568169:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568252:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fb68ab1/0x3e0030720b206eec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851268.568265:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851268.568272:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851268.568272:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568275:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.568279:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851268.568285:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.568291:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.568295:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.568304:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.568312:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.568319:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.568350:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851268.568368:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.568374:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568382:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.568385:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568393:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568404:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568410:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3d3dd4b/0x3e0030720b206ef3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.568424:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.568426:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.568427:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851268.568677:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.568683:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.568692:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.568695:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.568700:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.568710:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.568720:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.568727:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.568753:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788851268.569937:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.569947:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.569961:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.569971:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.569977:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.569987:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.569997:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.570005:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.570035:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788851268.570217:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851268.570224:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570232:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.570236:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570257:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570273:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570280:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dcddbba/0x3e0030720b206efa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570296:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.570300:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570306:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.570310:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570317:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570327:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570334:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd41326/0x3e0030720b206f01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.570358:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.570360:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.570362:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.570369:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851268.570621:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.570627:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.570636:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.570639:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.570643:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.570652:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.570661:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.570674:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.572299:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1788851268.573993:0:19531:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788851268.574060:0:19531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788851268.574065:0:19531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788851268.574228:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17955:x1875746019811584:12345-0@lo:5:osp-pre-1-1.0 Request processed in 22146us (23399us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788851268.574239:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788851268.574300:0:17955:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788851268.574308:0:17955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17955:1875746019811584:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788851268.574325:0:17955:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788851268.574383:0:17955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17955:1875746019811712:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788851268.574418:0:17955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851268.574452:0:17955:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea7e71f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851268.574470:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019811712 00000100:00100000:0.0:1788851268.574477:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019811712 00010000:00010000:3.0:1788851268.574650:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.574660:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.574672:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.574677:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.574688:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.574711:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.574719:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000851540fe/0x3e0030720b206f08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.574743:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.574745:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.574746:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851268.574940:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851268.574951:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17955:x1875746019811712:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788851268.575002:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17955:x1875746019811712:12345-0@lo:900:osp-pre-1-1.0 Request processed in 54us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851268.575008:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788851268.575058:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e87c33480 x1875746019811712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788851284 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851268.575069:0:17955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c33480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17955:1875746019811712:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788851268.575750:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.575760:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.575774:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.575778:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.575785:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.575798:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.575808:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.575817:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.575877:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788851268.576341:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.576347:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.576363:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.576366:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.576370:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.576379:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.576387:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.576394:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576678:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851268.576686:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576701:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.576705:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576714:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576733:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576740:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b177df83/0x3e0030720b206f0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576759:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.576762:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576769:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.576772:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576779:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576788:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.576800:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.576802:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.576803:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851268.576890:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788851268.576895:0:19145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9c3d2e2/0x3e0030720b206f16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.577265:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851268.577357:0:19145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851268.577364:0:19145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.577373:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788851268.577377:0:19145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851268.577381:0:19145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.577402:0:19145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.577410:0:19145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.577417:0:19145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851268.577470:0:19145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788851268.577516:0:19145:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1788851268.577621:0:19145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17239:x1875746019811072:12345-0@lo:5:osp-pre-1-0.0 Request processed in 40117us (41986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851268.577634:0:19145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788851268.577696:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17239:1875746019811072:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788851268.577715:0:17239:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788851268.577762:0:17239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17239:1875746019811840:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788851268.577798:0:17239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851268.577821:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d88a380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851268.577841:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019811840 00000100:00100000:2.0:1788851268.577848:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019811840 00000100:00100000:2.0:1788851268.577889:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788851268.577898:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17239:x1875746019811840:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788851268.577932:0:18719:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1788851268.580533:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17239:x1875746019811840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2629us (2727us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788851268.580548:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788851268.580633:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c35180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17239:1875746019811840:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788851268.580650:0:17239:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1788851268.580808:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851268.580819:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.580833:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851268.580839:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.580852:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.580875:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.580882:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b206f1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851268.580909:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.580911:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851268.580913:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851268.729938:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851269.046820:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019811968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851269.046899:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851269.046979:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019811968 00000100:00100000:3.0:1788851269.046987:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019811968 00000100:00100000:3.0:1788851269.047055:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851269.047067:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019811968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788851269.047098:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851269.047158:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019811968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851269.047164:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851269.047207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019811968:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788851269.428299:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851269.556228:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851269.556256:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019812096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851269.556339:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851269.556393:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019812096 00000100:00100000:1.0:1788851269.556403:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019812096 00000100:00100000:3.0:1788851269.556408:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851269.556420:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019812224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851269.556461:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851269.556474:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019812224 00000100:00100000:1.0:1788851269.556479:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019812224 00000100:00100000:3.0:1788851269.556499:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788851269.556511:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019812096:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851269.556578:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788851269.556586:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019812224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851269.556591:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:1.0:1788851269.556609:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788851269.556643:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019812096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851269.556651:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788851269.556728:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019812224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851269.556736:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788851269.556778:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019812224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851269.556816:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019812096:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788851270.379656:0:19887:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1788851270.388730:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788851270.457188:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851271.092239:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019812352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851271.092348:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851271.092434:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019812352 00000100:00100000:3.0:1788851271.092444:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019812352 00000100:00100000:3.0:1788851271.092536:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851271.092561:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019812352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851271.092882:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851271.092955:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019812352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 398us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851271.092963:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851271.093061:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019812352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788851271.093806:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788851271.476586:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788851271.790877:0:19940:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851271.792412:0:19940:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788851272.502613:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788851272.788400:0:19990:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788851272.788760:0:19990:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788851273.238973:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851273.239178:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850048 00000100:00100000:2.0:1788851273.239189:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850048 00000100:00100000:2.0:1788851273.239271:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:2.0:1788851273.239281:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1875746000850048:12345-192.168.204.27@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788851273.239311:0:17205:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2d11739f-0de9-4ad9-a829-6d1cc8cc568e@192.168.204.27@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1788851273.239344:0:17205:0:(genops.c:1384:class_connect()) connect: client 2d11739f-0de9-4ad9-a829-6d1cc8cc568e, cookie 0x3e0030720b206f24 00000100:00080000:2.0:1788851273.239529:0:17205:0:(import.c:65:import_set_state_nolock()) ffff892d81a63800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851273.239611:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+5:2406:x1875746000850048:12345-192.168.204.27@tcp:250:mount.lustre.0 Request processed in 329us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.239620:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:2.0:1788851273.244282:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.244403:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850176 00000100:00100000:0.0:1788851273.244415:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850176 00000100:00100000:0.0:1788851273.244525:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:0.0:1788851273.244537:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+5:14932:x1875746000850176:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788851273.244556:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851273.244578:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eebb000/0x3e0030720b206f2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38e02 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.244611:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebb000/0x3e0030720b206f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e02 expref: 6 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.244623:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eebb000/0x3e0030720b206f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e02 expref: 6 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.244653:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebb000, rc 0) 00000100:00100000:0.0:1788851273.244730:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+6:14932:x1875746000850176:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 196us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.244742:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:0.0:1788851273.250166:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851273.250394:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850304 00000100:00100000:2.0:1788851273.250408:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850304 00000100:00100000:2.0:1788851273.250494:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:2.0:1788851273.250506:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+6:14932:x1875746000850304:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788851273.250641:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+6:14932:x1875746000850304:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 137us (485us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788851273.250650:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:3.0:1788851273.253730:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.253930:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850432 00000100:00100000:0.0:1788851273.253942:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850432 00000100:00100000:0.0:1788851273.254098:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:0.0:1788851273.254109:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+6:14932:x1875746000850432:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788851273.254126:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851273.254143:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eebae00/0x3e0030720b206f32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38e09 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.254171:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebae00/0x3e0030720b206f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e09 expref: 7 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.254182:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eebae00/0x3e0030720b206f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e09 expref: 7 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.254190:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebae00, rc 0) 00000100:00100000:0.0:1788851273.254241:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+7:14932:x1875746000850432:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 134us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.254260:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:3.0:1788851273.264226:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.265053:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850560 00000100:00100000:0.0:1788851273.265066:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850560 00000100:00100000:0.0:1788851273.265138:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:0.0:1788851273.265161:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+7:14932:x1875746000850560:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788851273.265334:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14932:x1875746000850560:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 175us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.265597:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:1.0:1788851273.272086:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.272226:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850688 00000100:00100000:0.0:1788851273.272239:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850688 00000100:00100000:0.0:1788851273.272311:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:0.0:1788851273.272324:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14932:x1875746000850688:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788851273.272606:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14932:x1875746000850688:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 285us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.272615:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:3.0:1788851273.280324:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851273.280943:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850816 00000100:00100000:2.0:1788851273.280957:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850816 00000100:00100000:2.0:1788851273.281082:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:2.0:1788851273.281092:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14951:x1875746000850816:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851273.281263:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14951:x1875746000850816:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 171us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.281271:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:3.0:1788851273.306673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851273.306867:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850944 00000100:00100000:2.0:1788851273.306883:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850944 00000100:00100000:2.0:1788851273.306964:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:2.0:1788851273.306978:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14951:x1875746000850944:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851273.307345:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14951:x1875746000850944:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 369us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.307355:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:1.0:1788851273.314896:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.314992:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851072 00000100:00100000:0.0:1788851273.315003:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851072 00000100:00100000:0.0:1788851273.315103:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:0.0:1788851273.315113:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14951:x1875746000851072:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788851273.315259:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14951:x1875746000851072:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 147us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.315266:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:3.0:1788851273.321684:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.321932:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851200 00000100:00100000:0.0:1788851273.321943:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851200 00000100:00100000:0.0:1788851273.322009:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:0.0:1788851273.322064:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+8:14932:x1875746000851200:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788851273.322087:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851273.322109:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eebbc00/0x3e0030720b206f39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38e3a expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.322164:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebbc00/0x3e0030720b206f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e3a expref: 9 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.322176:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eebbc00/0x3e0030720b206f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e3a expref: 9 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.322186:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebbc00, rc 0) 00000100:00100000:0.0:1788851273.322243:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+9:14932:x1875746000851200:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 182us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.322250:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:3.0:1788851273.332632:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851273.332856:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851328 00000100:00100000:2.0:1788851273.332868:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851328 00000100:00100000:2.0:1788851273.332949:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:2.0:1788851273.332960:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+9:14932:x1875746000851328:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788851273.332995:0:17206:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788851273.333073:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788851273.333079:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788851273.333082:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788851273.333085:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788851273.333088:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788851273.336314:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+9:14932:x1875746000851328:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 3345us (3680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.336330:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:3.0:1788851273.350596:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851273.350815:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851456 00000100:00100000:2.0:1788851273.350841:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851456 00000100:00100000:2.0:1788851273.350901:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:2.0:1788851273.350911:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+9:14932:x1875746000851456:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851273.350939:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851273.350958:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38e41 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851273.350988:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e41 expref: 10 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851273.351000:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e41 expref: 10 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851273.351051:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94400, rc 0) 00000100:00100000:2.0:1788851273.351108:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:14932:x1875746000851456:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 198us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.351115:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:3.0:1788851273.355167:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851273.355273:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851584 00000100:00100000:2.0:1788851273.355286:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851584 00000100:00100000:2.0:1788851273.355452:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:2.0:1788851273.355463:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:14932:x1875746000851584:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788851273.355637:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:14932:x1875746000851584:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 175us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.355644:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:1.0:1788851273.360153:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.360386:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851712 00000100:00100000:0.0:1788851273.360398:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851712 00000100:00100000:0.0:1788851273.360463:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:0.0:1788851273.360474:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:14932:x1875746000851712:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788851273.362003:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:14932:x1875746000851712:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 1445us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.362035:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:3.0:1788851273.366629:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851273.367375:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851840 00000100:00100000:2.0:1788851273.367388:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851840 00000100:00100000:2.0:1788851273.367577:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:2.0:1788851273.367589:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:14956:x1875746000851840:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851273.367787:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:14956:x1875746000851840:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 199us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.367797:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:3.0:1788851273.374426:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.374543:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851968 00000100:00100000:0.0:1788851273.374555:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851968 00000100:00100000:0.0:1788851273.374625:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:0.0:1788851273.374636:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:14956:x1875746000851968:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788851273.374817:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:14956:x1875746000851968:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 182us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.374825:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:1.0:1788851273.379674:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851273.380688:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852096 00000100:00100000:3.0:1788851273.380701:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852096 00000100:00100000:3.0:1788851273.380763:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851273.380772:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1875746000852096:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788851273.380802:0:18245:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5cfece06-2f06-458e-aaf0-aac64f28cf2c@192.168.204.27@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:3.0:1788851273.380851:0:18245:0:(genops.c:1384:class_connect()) connect: client 5cfece06-2f06-458e-aaf0-aac64f28cf2c, cookie 0x3e0030720b206f47 00000004:00100000:3.0:1788851273.380876:0:18245:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788851273.381145:0:18245:0:(import.c:65:import_set_state_nolock()) ffff892d815ab000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851273.381218:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:2406:x1875746000852096:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 445us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.381226:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1788851273.381308:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851273.384125:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852352 00000100:00100000:3.0:1788851273.384142:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852352 00000100:00100000:3.0:1788851273.384203:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1788851273.384211:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1875746000852352:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788851273.384245:0:17213:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 5cfece06-2f06-458e-aaf0-aac64f28cf2c@192.168.204.27@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:3.0:1788851273.384297:0:17213:0:(genops.c:1384:class_connect()) connect: client 5cfece06-2f06-458e-aaf0-aac64f28cf2c, cookie 0x3e0030720b206f4e 00000004:00100000:3.0:1788851273.384335:0:17213:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788851273.384565:0:17213:0:(import.c:65:import_set_state_nolock()) ffff892d815ae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851273.384698:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:2406:x1875746000852352:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 423us (3326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.384707:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:1.0:1788851273.392230:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851273.392278:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851273.393074:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852480 00000100:00100000:3.0:1788851273.393087:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852480 00000100:00100000:3.0:1788851273.393183:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852224 00000100:00100000:3.0:1788851273.393187:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852224 00000100:00100000:3.0:1788851273.393215:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1788851273.393224:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:0:x1875746000852480:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788851273.393264:0:18245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851273.393439:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:2.0:1788851273.393449:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:0:x1875746000852224:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788851273.393468:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788851273.393568:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:0:x1875746000852224:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 121us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.393575:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1788851273.393746:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:0:x1875746000852480:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 521us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.393752:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00080000:1.0:1788851273.395441:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851273.395450:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851273.403878:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851273.404208:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852608 00000100:00100000:3.0:1788851273.404238:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852608 00000100:00100000:3.0:1788851273.404311:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1788851273.404331:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:14932:x1875746000852608:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788851273.404365:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788851273.404696:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:14932:x1875746000852608:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 375us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.404706:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1788851273.407911:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851273.409642:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852736 00000100:00100000:1.0:1788851273.409660:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852736 00000100:00100000:1.0:1788851273.409756:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1788851273.409769:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:14932:x1875746000852736:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788851273.409884:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:14932:x1875746000852736:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 117us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851273.409893:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1788851273.416882:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851273.416929:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851273.416977:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.417090:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853120 00000100:00100000:0.0:1788851273.417120:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853120 00000100:00100000:0.0:1788851273.417188:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1788851273.417199:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:14932:x1875746000853120:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788851273.417283:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:14932:x1875746000853120:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 84us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.417290:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:2.0:1788851273.417434:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852864 00000100:00100000:2.0:1788851273.417439:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852864 00000100:00100000:2.0:1788851273.417468:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852992 00000100:00100000:2.0:1788851273.417471:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852992 00000100:00100000:2.0:1788851273.417500:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1788851273.417515:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875746000852864:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788851273.417542:0:18721:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5cfece06-2f06-458e-aaf0-aac64f28cf2c@192.168.204.27@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1788851273.417580:0:18721:0:(genops.c:1384:class_connect()) connect: client 5cfece06-2f06-458e-aaf0-aac64f28cf2c, cookie 0x3e0030720b206f55 00002000:00100000:2.0:1788851273.417591:0:18721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5cfece06-2f06-458e-aaf0-aac64f28cf2c/ffff892d81a66800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851273.417609:0:18721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788851273.417802:0:18721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788851273.417833:0:18721:0:(import.c:65:import_set_state_nolock()) ffff892d81a64000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851273.417867:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:2406:x1875746000852864:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 352us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.417884:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1788851273.417899:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1788851273.417903:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875746000852992:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788851273.417921:0:18721:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5cfece06-2f06-458e-aaf0-aac64f28cf2c@192.168.204.27@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1788851273.417938:0:18721:0:(genops.c:1384:class_connect()) connect: client 5cfece06-2f06-458e-aaf0-aac64f28cf2c, cookie 0x3e0030720b206f5c 00002000:00100000:2.0:1788851273.417943:0:18721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5cfece06-2f06-458e-aaf0-aac64f28cf2c/ffff892d81a63000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851273.417955:0:18721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788851273.418099:0:18721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788851273.418114:0:18721:0:(import.c:65:import_set_state_nolock()) ffff892d81a66000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851273.418138:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:2406:x1875746000852992:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 233us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.418145:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1788851273.426871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851273.427200:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853248 00000100:00100000:1.0:1788851273.427211:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853248 00000100:00100000:1.0:1788851273.427272:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:1.0:1788851273.427283:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:14932:x1875746000853248:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788851273.433760:0:17215:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6373us 00000004:00200000:1.0:1788851273.461992:0:17215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788851273.462179:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:14932:x1875746000853248:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 34882us (35301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851273.462191:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00010000:00010000:0.0:1788851273.524246:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851273.639175:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851273.639345:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853376 00000100:00100000:0.0:1788851273.639366:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853376 00000100:00100000:0.0:1788851273.639444:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1788851273.639456:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:14979:x1875746000853376:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:0.0:1788851273.639497:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851273.639524:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb200/0x3e0030720b206f63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38e72 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.639605:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b206f6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.639621:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b206f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.639637:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b206f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851273.639704:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788851273.639708:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851273.639747:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b206f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.639776:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb200/0x3e0030720b206f63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e72 expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.639815:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b206f6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e72 expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851273.639824:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8b00) 00010000:00010000:0.0:1788851273.639828:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851273.639831:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebbe00, rc 0) 00000100:00100000:0.0:1788851273.639997:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:14979:x1875746000853376:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 543us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851273.640006:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1788851273.652533:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019812480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851273.652617:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851273.652714:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019812480 00000100:00100000:2.0:1788851273.652722:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019812480 00000100:00100000:2.0:1788851273.652769:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788851273.652779:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019812480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851273.652800:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788851273.654542:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019812480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1758us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.654554:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788851273.654618:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019812480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851273.655403:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019812736:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655484:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655515:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019813248:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655541:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655560:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019813760:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655583:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655603:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788851273.655608:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019812608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851273.655630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655645:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019813120:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655676:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655695:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019813632:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655714:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655730:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019814144:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655753:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655780:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019812864:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655802:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655820:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019813376:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655853:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655868:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019813888:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655888:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655899:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788851273.655904:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019812992:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655923:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655937:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019813504:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.655966:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.655982:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019814016:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.656002:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851273.656050:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019813760 00000100:00100000:2.0:1788851273.656168:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019813376 00000100:00100000:2.0:1788851273.656175:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019813376 00000100:00100000:2.0:1788851273.656217:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019812992 00000100:00100000:2.0:1788851273.656220:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019812992 00000100:00100000:2.0:1788851273.656921:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019813504 00000100:00100000:2.0:1788851273.656927:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019813504 00000100:00100000:2.0:1788851273.656959:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788851273.656969:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019813376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851273.657062:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019813376:12345-0@lo:400:kworker.0 Request processed in 94us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.657069:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788851273.657088:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851273.657094:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019812992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851273.657122:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019812992:12345-0@lo:400:kworker.0 Request processed in 30us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.657128:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851273.657139:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788851273.657145:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019813504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851273.657188:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019813504:12345-0@lo:400:kworker.0 Request processed in 43us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.657194:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851273.657866:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019813248 00000100:00100000:3.0:1788851273.657874:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019813248 00000100:00100000:3.0:1788851273.657908:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019812864 00000100:00100000:3.0:1788851273.657911:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019812864 00000100:00100000:3.0:1788851273.657928:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788851273.657934:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019813248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851273.657992:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019813248:12345-0@lo:400:kworker.0 Request processed in 58us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.657999:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788851273.658029:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788851273.658035:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019812864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851273.658066:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019812864:12345-0@lo:400:kworker.0 Request processed in 31us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.658072:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788851273.658092:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019812608 00000100:00100000:3.0:1788851273.658096:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019812608 00000100:00100000:3.0:1788851273.658120:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851273.658126:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019812608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788851273.658150:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788851273.658198:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019812608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.658203:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851273.658264:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019813120 00000100:00100000:3.0:1788851273.658269:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019813120 00000100:00100000:3.0:1788851273.658288:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019813632 00000100:00100000:3.0:1788851273.658290:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019813632 00000100:00100000:3.0:1788851273.658300:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019814144 00000100:00100000:3.0:1788851273.658303:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019814144 00000100:00100000:3.0:1788851273.658318:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019813888 00000100:00100000:3.0:1788851273.658321:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019813888 00000100:00100000:3.0:1788851273.658336:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019814016 00000100:00100000:3.0:1788851273.658338:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019814016 00000100:00100000:3.0:1788851273.658353:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788851273.658359:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019813120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851273.658390:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019813120:12345-0@lo:400:kworker.0 Request processed in 31us (2714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.658395:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788851273.658470:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019812992:0@lo:400:kworker.0 00000100:00100000:2.0:1788851273.658503:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019813504:0@lo:400:kworker.0 00000100:00100000:2.0:1788851273.658514:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019812864:0@lo:400:kworker.0 00000100:00100000:2.0:1788851273.658524:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019813376:0@lo:400:kworker.0 00000100:00100000:3.0:1788851273.658609:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851273.658617:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019813632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851273.658710:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019813632:12345-0@lo:400:kworker.0 Request processed in 33us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.658717:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851273.658731:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788851273.658737:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019814144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851273.658782:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019814144:12345-0@lo:400:kworker.0 Request processed in 46us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.658794:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788851273.658807:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788851273.658813:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019813888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851273.658846:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019813888:12345-0@lo:400:kworker.0 Request processed in 33us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.658851:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788851273.658862:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788851273.658867:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019814016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851273.658893:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019814016:12345-0@lo:400:kworker.0 Request processed in 26us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851273.658898:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788851273.659145:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851273.659150:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851273.659153:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851273.659155:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851273.659353:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019814016:0@lo:400:kworker.0 00010000:00080000:3.0:1788851273.659368:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a3b800 x1875746019813888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851273.659379:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019813888:0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.659828:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019813760 00000100:00100000:1.0:1788851273.659875:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851273.659882:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019813760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851273.659929:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019813760:12345-0@lo:400:kworker.0 Request processed in 47us (4345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851273.659934:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788851273.660088:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851273.660449:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019812736 00000100:00100000:2.0:1788851273.660457:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019812736 00000100:00100000:2.0:1788851273.660505:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788851273.660513:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:3648:x1875746019812736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851273.660552:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:3648:x1875746019812736:12345-0@lo:400:kworker.0 Request processed in 40us (5078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851273.660558:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788851273.660971:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019812608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851273.661005:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019813120:0@lo:400:kworker.0 00000100:00100000:0.0:1788851273.661032:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019813632:0@lo:400:kworker.0 00010000:00080000:0.0:1788851273.661053:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a38380 x1875746019814144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851273.661064:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019814144:0@lo:400:kworker.0 00000100:00100000:0.0:1788851273.661073:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019812736:0@lo:400:kworker.0 00000100:00100000:0.0:1788851273.661083:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019813248:0@lo:400:kworker.0 00000100:00100000:0.0:1788851273.661099:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019813760:0@lo:400:kworker.0 00000001:00100000:3.0:1788851273.662103:0:19531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000001:00080000:3.0:1788851273.662119:0:19531:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788851274.167792:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019814272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788851274.167880:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851274.168414:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019814272 00000100:00100000:3.0:1788851274.168423:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019814272 00000100:00100000:3.0:1788851274.168486:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851274.168496:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019814272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788851274.168519:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851274.168568:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019814272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851274.168588:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851274.168726:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019814272:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788851274.548757:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851274.676769:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019814400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851274.676972:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851274.677108:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019814528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851274.677242:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851274.677550:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019814400 00000100:00100000:1.0:1788851274.677560:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019814400 00000100:00100000:1.0:1788851274.677622:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019814528 00000100:00100000:1.0:1788851274.677626:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019814528 00000100:00100000:1.0:1788851274.677643:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788851274.677652:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019814400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788851274.677687:0:18246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788851274.677812:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788851274.677900:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019814528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788851274.677920:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788851274.677956:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019814528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851274.677963:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788851274.678136:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019814528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851274.681515:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019814400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3852us (4660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851274.681533:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788851274.681564:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019814400:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788851275.572249:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851275.823782:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851275.824076:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853504 00000100:00100000:0.0:1788851275.824088:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853504 00000100:00100000:0.0:1788851275.824218:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1788851275.824232:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:15032:x1875746000853504:12345-192.168.204.27@tcp:41:lfs.0 00000004:00000024:0.0:1788851275.824275:0:17212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788851275.824394:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:15032:x1875746000853504:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 166us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851275.824403:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00080000:3.0:1788851275.825226:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851275.827994:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851275.828697:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853632 00000100:00100000:0.0:1788851275.828710:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853632 00000100:00100000:0.0:1788851275.828824:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1788851275.828836:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:15032:x1875746000853632:12345-192.168.204.27@tcp:41:lfs.0 00000004:00000024:0.0:1788851275.828877:0:17214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788851275.829072:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:15032:x1875746000853632:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 237us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851275.829080:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:3.0:1788851275.829549:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851275.836820:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851275.836987:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853760 00000100:00100000:3.0:1788851275.836998:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853760 00000100:00100000:3.0:1788851275.837169:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1788851275.837180:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:15032:x1875746000853760:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:3.0:1788851275.837228:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851275.837321:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:15032:x1875746000853760:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 142us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851275.837329:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00080000:0.0:1788851275.841292:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851275.841758:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851275.841865:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853888 00000100:00100000:3.0:1788851275.841877:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853888 00000100:00100000:3.0:1788851275.841946:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1788851275.841956:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:15032:x1875746000853888:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:3.0:1788851275.841987:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788851275.842171:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851275.842206:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:15032:x1875746000853888:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 251us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851275.842216:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1788851276.009952:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851276.010068:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854016 00000100:00100000:2.0:1788851276.010079:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854016 00000100:00100000:2.0:1788851276.010139:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:2.0:1788851276.010150:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:15062:x1875746000854016:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851276.010168:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851276.010186:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff95e00/0x3e0030720b206f71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38e79 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851276.010218:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff95e00/0x3e0030720b206f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e79 expref: 11 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851276.010231:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff95e00/0x3e0030720b206f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e79 expref: 11 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851276.010241:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95e00, rc 0) 00000100:00100000:2.0:1788851276.010327:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15062:x1875746000854016:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 179us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851276.010336:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:1.0:1788851276.022617:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851276.027688:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854144 00000100:00100000:2.0:1788851276.027705:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854144 00000100:00100000:2.0:1788851276.027793:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:2.0:1788851276.027804:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15062:x1875746000854144:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788851276.028066:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15062:x1875746000854144:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 263us (5467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851276.028075:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:3.0:1788851276.031217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851276.031322:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854272 00000100:00100000:1.0:1788851276.031347:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854272 00000100:00100000:1.0:1788851276.031424:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:1.0:1788851276.031445:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15062:x1875746000854272:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788851276.031625:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15062:x1875746000854272:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 180us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851276.031963:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:1.0:1788851276.037544:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851276.037648:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854400 00000100:00100000:2.0:1788851276.037658:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854400 00000100:00100000:2.0:1788851276.037721:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:2.0:1788851276.037733:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15070:x1875746000854400:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851276.037909:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15070:x1875746000854400:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 178us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851276.037917:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:2.0:1788851276.067500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851276.067663:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854528 00000100:00100000:1.0:1788851276.067676:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854528 00000100:00100000:1.0:1788851276.067742:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:1.0:1788851276.067753:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15070:x1875746000854528:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851276.067938:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15070:x1875746000854528:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 185us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851276.067946:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:3.0:1788851276.072696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851276.073061:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854656 00000100:00100000:0.0:1788851276.073074:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854656 00000100:00100000:0.0:1788851276.073135:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:0.0:1788851276.073144:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8a8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15070:x1875746000854656:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788851276.073296:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8a8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15070:x1875746000854656:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 153us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851276.073304:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:3.0:1788851276.088807:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851276.088979:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854784 00000100:00100000:2.0:1788851276.088991:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854784 00000100:00100000:2.0:1788851276.089089:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:2.0:1788851276.089100:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8678a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:15062:x1875746000854784:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851276.089117:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851276.089137:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff95000/0x3e0030720b206f78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38eaa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851276.089186:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff95000/0x3e0030720b206f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eaa expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851276.089197:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff95000/0x3e0030720b206f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eaa expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851276.089220:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95000, rc 0) 00000100:00100000:2.0:1788851276.089279:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8678a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:15062:x1875746000854784:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 181us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851276.089287:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:2.0:1788851276.094519:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851276.094594:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854912 00000100:00100000:1.0:1788851276.094610:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854912 00000100:00100000:1.0:1788851276.094779:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:1.0:1788851276.094790:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8678a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:15062:x1875746000854912:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788851276.094823:0:17205:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788851276.094851:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788851276.094856:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788851276.094859:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788851276.094863:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788851276.094865:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788851276.096637:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8678a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:15062:x1875746000854912:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 1833us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851276.096669:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:3.0:1788851276.101325:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851276.101531:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855040 00000100:00100000:0.0:1788851276.101542:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855040 00000100:00100000:0.0:1788851276.101607:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:0.0:1788851276.101618:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:15062:x1875746000855040:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788851276.101635:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851276.101848:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38eb1 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851276.101882:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eb1 expref: 13 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851276.101892:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eb1 expref: 13 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851276.101900:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebb200, rc 0) 00000100:00100000:0.0:1788851276.102080:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:15062:x1875746000855040:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 464us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851276.102101:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:2.0:1788851276.104207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851276.104392:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855168 00000100:00100000:1.0:1788851276.104403:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855168 00000100:00100000:1.0:1788851276.104478:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:1.0:1788851276.104488:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:15062:x1875746000855168:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788851276.104690:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:15062:x1875746000855168:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 202us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851276.104698:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:3.0:1788851276.107292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851276.107384:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855296 00000100:00100000:0.0:1788851276.107393:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855296 00000100:00100000:0.0:1788851276.107464:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:0.0:1788851276.107477:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:15062:x1875746000855296:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788851276.107682:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:15062:x1875746000855296:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 208us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851276.107691:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:3.0:1788851276.111054:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851276.111149:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855424 00000100:00100000:2.0:1788851276.111159:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855424 00000100:00100000:2.0:1788851276.111217:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:2.0:1788851276.111227:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:15073:x1875746000855424:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851276.111373:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:15073:x1875746000855424:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 146us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851276.111381:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:2.0:1788851276.121778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851276.122054:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855552 00000100:00100000:1.0:1788851276.122066:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855552 00000100:00100000:1.0:1788851276.122124:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 144 00000100:00100000:1.0:1788851276.122134:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:15073:x1875746000855552:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851276.122302:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:15073:x1875746000855552:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 168us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851276.122311:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 144 00000100:00100000:3.0:1788851276.136960:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851276.137058:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851276.138268:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855680 00000100:00100000:0.0:1788851276.138282:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855680 00000100:00100000:0.0:1788851276.138337:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855936 00000100:00100000:0.0:1788851276.138341:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855936 00000100:00100000:0.0:1788851276.138376:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1788851276.138384:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875746000855680:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788851276.138417:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 328c7902-b357-4550-8a0f-a89bc9b6ec05@192.168.204.27@tcp t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:0.0:1788851276.138480:0:17212:0:(genops.c:1384:class_connect()) connect: client 328c7902-b357-4550-8a0f-a89bc9b6ec05, cookie 0x3e0030720b206f86 00000004:00100000:0.0:1788851276.138506:0:17212:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788851276.138631:0:17212:0:(import.c:65:import_set_state_nolock()) ffff892d81a1f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851276.138701:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2406:x1875746000855680:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 316us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851276.138709:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1788851276.138727:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1788851276.138731:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875746000855936:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788851276.138746:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 328c7902-b357-4550-8a0f-a89bc9b6ec05@192.168.204.27@tcp t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:0.0:1788851276.138795:0:17212:0:(genops.c:1384:class_connect()) connect: client 328c7902-b357-4550-8a0f-a89bc9b6ec05, cookie 0x3e0030720b206f8d 00000004:00100000:0.0:1788851276.138808:0:17212:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788851276.138855:0:17212:0:(import.c:65:import_set_state_nolock()) ffff892eb699a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851276.138879:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2406:x1875746000855936:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 146us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851276.138885:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1788851276.143958:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851276.144002:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851276.144110:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851276.144314:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856064 00000100:00100000:1.0:1788851276.144325:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856064 00000100:00100000:1.0:1788851276.144402:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855808 00000100:00100000:1.0:1788851276.144405:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855808 00000100:00100000:1.0:1788851276.144420:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856192 00000100:00100000:1.0:1788851276.144422:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856192 00000100:00100000:1.0:1788851276.144448:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1788851276.144468:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:0:x1875746000856064:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788851276.144509:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788851276.144593:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:0:x1875746000856064:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 112us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851276.144616:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1788851276.144633:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788851276.144639:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+7:0:x1875746000855808:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788851276.144656:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788851276.144685:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+7:0:x1875746000855808:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 45us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851276.144691:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788851276.144704:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1788851276.144710:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15062:x1875746000856192:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788851276.144720:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788851276.144739:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15062:x1875746000856192:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851276.144746:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00080000:3.0:1788851276.144818:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851276.144822:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851276.149075:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851276.149173:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856320 00000100:00100000:1.0:1788851276.149185:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856320 00000100:00100000:1.0:1788851276.149248:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1788851276.149258:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15062:x1875746000856320:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788851276.149370:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15062:x1875746000856320:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 112us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851276.149378:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1788851276.153087:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851276.153119:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851276.153152:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851276.153254:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856704 00000100:00100000:0.0:1788851276.153265:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856704 00000100:00100000:0.0:1788851276.153335:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1788851276.153345:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15062:x1875746000856704:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788851276.153447:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15062:x1875746000856704:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 102us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851276.153455:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1788851276.153561:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856448 00000100:00100000:2.0:1788851276.153565:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856448 00000100:00100000:2.0:1788851276.153594:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856576 00000100:00100000:2.0:1788851276.153597:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856576 00000100:00100000:2.0:1788851276.153614:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1788851276.153634:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875746000856448:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788851276.153661:0:18721:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 328c7902-b357-4550-8a0f-a89bc9b6ec05@192.168.204.27@tcp t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:2.0:1788851276.153688:0:18721:0:(genops.c:1384:class_connect()) connect: client 328c7902-b357-4550-8a0f-a89bc9b6ec05, cookie 0x3e0030720b206f94 00002000:00100000:2.0:1788851276.153700:0:18721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 328c7902-b357-4550-8a0f-a89bc9b6ec05/ffff892d81a60000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851276.153709:0:18721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788851276.153783:0:18721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788851276.153806:0:18721:0:(import.c:65:import_set_state_nolock()) ffff892d81a60800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851276.153832:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2406:x1875746000856448:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 198us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851276.153839:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1788851276.153851:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1788851276.153856:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875746000856576:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788851276.153868:0:18721:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 328c7902-b357-4550-8a0f-a89bc9b6ec05@192.168.204.27@tcp t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:2.0:1788851276.153882:0:18721:0:(genops.c:1384:class_connect()) connect: client 328c7902-b357-4550-8a0f-a89bc9b6ec05, cookie 0x3e0030720b206f9b 00002000:00100000:2.0:1788851276.153887:0:18721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 328c7902-b357-4550-8a0f-a89bc9b6ec05/ffff892e83e28800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851276.153892:0:18721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788851276.153927:0:18721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788851276.153940:0:18721:0:(import.c:65:import_set_state_nolock()) ffff892d881f7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851276.153963:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2406:x1875746000856576:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 105us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851276.153970:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1788851276.157343:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851276.158347:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856832 00000100:00100000:0.0:1788851276.158374:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856832 00000100:00100000:0.0:1788851276.158449:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:0.0:1788851276.158461:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15062:x1875746000856832:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788851276.158553:0:17216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788851276.158861:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15062:x1875746000856832:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 401us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851276.158869:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1788851276.212400:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019814656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851276.212486:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851276.212829:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019814656 00000100:00100000:2.0:1788851276.212839:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019814656 00000100:00100000:2.0:1788851276.212908:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788851276.212932:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019814656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851276.212956:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788851276.213002:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019814656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851276.213008:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788851276.213086:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851276.213164:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019814656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851276.328231:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851276.328336:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856960 00000100:00100000:0.0:1788851276.328346:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856960 00000100:00100000:0.0:1788851276.328407:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1788851276.328417:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15096:x1875746000856960:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:0.0:1788851276.328466:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851276.328488:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b206fa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ee2 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851276.328557:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851276.328572:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851276.328585:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851276.328628:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788851276.328633:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851276.328652:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851276.328678:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba800/0x3e0030720b206fa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee2 expref: 8 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851276.328697:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee2 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851276.328706:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8b00) 00010000:00010000:0.0:1788851276.328709:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851276.328712:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebac00, rc 0) 00000100:00100000:0.0:1788851276.328776:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+7:15096:x1875746000856960:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 360us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851276.328783:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00010000:00010000:1.0:1788851276.596654:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851277.621154:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851278.646333:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851278.773161:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851278.773186:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019814784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851278.773257:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851278.773324:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019814784 00000100:00100000:3.0:1788851278.773334:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019814784 00000100:00100000:3.0:1788851278.773401:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788851278.773410:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019814784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851278.773444:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788851278.773490:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019814784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851278.773498:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788851278.773520:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851278.773548:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788851278.773570:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019814784:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788851278.775226:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 328c7902-b357-4550-8a0f-a89bc9b6ec05 00000001:00100000:0.0:1788851278.775236:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000001:00100000:0.0:1788851278.777936:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 328c7902-b357-4550-8a0f-a89bc9b6ec05 00000001:00100000:0.0:1788851278.777951:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000001:00100000:3.0:1788851278.778653:0:18715:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 328c7902-b357-4550-8a0f-a89bc9b6ec05 00000001:00100000:3.0:1788851278.778662:0:18715:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000100:00100000:3.0:1788851278.778802:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851278.778825:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019814912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851278.778901:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851278.779070:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019815296:0@lo:400:kworker.0 00000100:00100000:1.0:1788851278.779138:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019814912 00000100:00100000:1.0:1788851278.779148:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019814912 00000100:00100000:1.0:1788851278.779208:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788851278.779218:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019814912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851278.779240:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788851278.779571:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019815424:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.782349:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851278.782428:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019815808:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.782529:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851278.782553:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019816320:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.782580:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851278.782619:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788851278.782625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019815168:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.782647:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851278.782672:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019815680:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.782691:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851278.782707:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019816192:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.782732:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851278.782771:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019815296 00000100:00100000:0.0:1788851278.782778:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019815296 00000100:00100000:0.0:1788851278.782910:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019815808 00000100:00100000:0.0:1788851278.782915:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019815808 00000100:00100000:0.0:1788851278.783039:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019815680 00000100:00100000:0.0:1788851278.783043:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019815680 00000100:00100000:0.0:1788851278.783063:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851278.783071:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019815296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783149:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019815296:12345-0@lo:400:kworker.0 Request processed in 78us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851278.783155:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851278.783172:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788851278.783396:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019815808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783429:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019815808:12345-0@lo:400:kworker.0 Request processed in 37us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851278.783435:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788851278.783447:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788851278.783464:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019815680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783491:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019815680:12345-0@lo:400:kworker.0 Request processed in 39us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851278.783496:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788851278.783519:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019815168 00000100:00100000:0.0:1788851278.783524:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019815168 00000100:00100000:0.0:1788851278.783550:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788851278.783556:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019815168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783609:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019815168:12345-0@lo:400:kworker.0 Request processed in 53us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851278.783616:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788851278.783642:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019816320 00000100:00100000:0.0:1788851278.783646:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019816320 00000100:00100000:0.0:1788851278.783674:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019816192 00000100:00100000:0.0:1788851278.783678:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019816192 00000100:00100000:0.0:1788851278.783699:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788851278.783705:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019816320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783744:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019816320:12345-0@lo:400:kworker.0 Request processed in 40us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851278.783751:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788851278.783762:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788851278.783769:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019816192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783792:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019816192:12345-0@lo:400:kworker.0 Request processed in 25us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851278.783797:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788851278.783866:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019815168:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783878:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019815680:0@lo:400:kworker.0 00010000:00080000:0.0:1788851278.783889:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88269180 x1875746019816192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851278.783898:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019816192:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783907:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019815296:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783916:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019815808:0@lo:400:kworker.0 00000100:00100000:0.0:1788851278.783925:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019816320:0@lo:400:kworker.0 00000100:00080000:0.0:1788851278.784137:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851278.784142:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851278.784144:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851278.784147:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851278.791117:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019814912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11892us (12208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851278.791150:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788851278.795688:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851278.795757:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019815424 00000100:00100000:2.0:1788851278.795766:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019815424 00000100:00100000:2.0:1788851278.795814:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788851278.795823:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019815424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.795876:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019815424:12345-0@lo:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851278.795883:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788851278.795926:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019815424:0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.795938:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019815936:0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.795964:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851278.795992:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019816448:0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.796051:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851278.796053:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019815936 00000100:00100000:1.0:1788851278.796059:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019815936 00000100:00100000:2.0:1788851278.796078:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019816448 00000100:00100000:2.0:1788851278.796084:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019816448 00000100:00100000:1.0:1788851278.796093:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788851278.796102:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019815936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.796128:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788851278.796136:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019816448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.796563:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019816448:12345-0@lo:400:kworker.0 Request processed in 427us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851278.796579:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788851278.796600:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788851278.796625:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88268000 x1875746019816448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851278.796637:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019816448:0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.796665:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788851278.796672:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019815040:0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.796704:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851278.796848:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019815040 00000100:00100000:2.0:1788851278.796854:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019815040 00000100:00100000:2.0:1788851278.796888:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788851278.796894:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+24:3649:x1875746019815040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.796928:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+24:3649:x1875746019815040:12345-0@lo:400:kworker.0 Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851278.796935:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788851278.796979:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019815040:0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.796987:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019815552:0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.797039:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851278.797065:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019816064:0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.797093:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851278.797115:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019816064 00000100:00100000:2.0:1788851278.797119:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019816064 00000100:00100000:2.0:1788851278.797147:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788851278.797153:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019816064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851278.797265:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019816064:12345-0@lo:400:kworker.0 Request processed in 111us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851278.797271:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788851278.797287:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851278.797306:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019816064:0@lo:400:kworker.0 00000100:00100000:3.0:1788851278.799209:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019814912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851278.799251:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019815552 00000100:00100000:3.0:1788851278.799257:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019815552 00000100:00100000:3.0:1788851278.799301:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788851278.799321:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019815552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851278.799572:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019815552:12345-0@lo:400:kworker.0 Request processed in 263us (2531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851278.799580:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788851278.799617:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019815552:0@lo:400:kworker.0 00000100:00100000:1.0:1788851278.802641:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019815936:12345-0@lo:400:kworker.0 Request processed in 6533us (6668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851278.802656:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788851278.802942:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019815936:0@lo:400:kworker.0 00000040:00080000:0.0:1788851278.969026:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788851279.048222:0:20088:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788851279.285474:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019816576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788851279.285577:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851279.285877:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019816576 00000100:00100000:3.0:1788851279.285888:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019816576 00000100:00100000:3.0:1788851279.285963:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788851279.285976:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019816576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788851279.286044:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851279.286097:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019816576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851279.286105:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788851279.286157:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019816576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788851279.668845:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851279.796417:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851279.796442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019816704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851279.796522:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851279.797030:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019816704 00000100:00100000:3.0:1788851279.797039:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019816704 00000100:00100000:3.0:1788851279.797102:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788851279.797113:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019816704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851279.797173:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788851279.797240:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019816704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851279.797247:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788851279.797658:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851279.797669:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019816832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851279.797706:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851279.797785:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019816832 00000100:00100000:2.0:1788851279.797791:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019816832 00000100:00100000:2.0:1788851279.797827:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788851279.797836:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019816832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851279.797855:0:18246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851279.797900:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019816832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851279.797907:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788851279.797983:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019816832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851279.798232:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019816704:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788851280.631109:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788851280.693384:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851281.334049:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851281.334073:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019816960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851281.334144:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851281.334186:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019816960 00000100:00100000:2.0:1788851281.334196:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019816960 00000100:00100000:2.0:1788851281.334274:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788851281.334286:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019816960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851281.334315:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788851281.334392:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019816960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851281.334401:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788851281.334557:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019816960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788851281.334620:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851281.652968:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851281.653056:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851281.653091:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851281.653139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851281.653170:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851281.653208:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851281.653239:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851281.653268:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851281.653306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851281.653360:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857344 00000100:00100000:3.0:1788851281.653372:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857344 00000100:00100000:0.0:1788851281.653638:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857600 00000100:00100000:0.0:1788851281.653644:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857600 00000100:00100000:0.0:1788851281.653708:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858112 00000100:00100000:0.0:1788851281.653711:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858112 00000100:00100000:0.0:1788851281.653725:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857472 00000100:00100000:0.0:1788851281.653727:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857472 00000100:00100000:0.0:1788851281.653739:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857984 00000100:00100000:0.0:1788851281.653741:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857984 00000100:00100000:0.0:1788851281.653759:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1788851281.653769:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2410:x1875746000857600:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851281.653852:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2410:x1875746000857600:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 85us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851281.653859:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1788851281.653874:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1788851281.653880:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2410:x1875746000858112:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851281.653903:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2410:x1875746000858112:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851281.653909:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1788851281.654168:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:1.0:1788851281.654177:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2410:x1875746000857472:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851281.654211:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2410:x1875746000857472:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851281.654218:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:1.0:1788851281.654230:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1788851281.654235:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2410:x1875746000857984:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851281.654256:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2410:x1875746000857984:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 20us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851281.654262:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1788851281.654283:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857856 00000100:00100000:1.0:1788851281.654288:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857856 00000100:00100000:1.0:1788851281.654310:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857216 00000100:00100000:1.0:1788851281.654313:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857216 00000100:00100000:1.0:1788851281.654340:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857728 00000100:00100000:1.0:1788851281.654355:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857728 00000100:00100000:1.0:1788851281.654371:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:1.0:1788851281.654377:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2410:x1875746000857856:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851281.654405:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2410:x1875746000857856:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851281.654412:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:1.0:1788851281.654428:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:1.0:1788851281.654434:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:2410:x1875746000857216:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851281.654459:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:2410:x1875746000857216:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851281.654465:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:1.0:1788851281.654477:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1788851281.654490:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2410:x1875746000857728:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851281.654516:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2410:x1875746000857728:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851281.654522:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1788851281.654561:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1788851281.654573:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2410:x1875746000857344:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851281.654606:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2410:x1875746000857344:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851281.654613:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00080000:0.0:1788851281.654813:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851281.654818:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851281.654820:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851281.654822:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851281.655862:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857088 00000100:00100000:2.0:1788851281.655871:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857088 00000100:00100000:2.0:1788851281.655916:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 146 00000100:00100000:2.0:1788851281.655937:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2410:x1875746000857088:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851281.656004:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2410:x1875746000857088:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 69us (3046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851281.656037:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 146 00010000:00010000:2.0:1788851281.717283:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788851281.850730:0:19531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 328c7902-b357-4550-8a0f-a89bc9b6ec05 00010000:00010000:1.0:1788851282.745491:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788851282.905337:0:20235:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9692de30 20000000:00000080:0.0:1788851282.905357:0:20235:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892eb69bb000 uarg=0000000000000000 20000000:01000000:0.0:1788851282.905463:0:20235:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788851282.905470:0:20235:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788851282.905475:0:20235:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788851282.908265:0:20236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788851282.908651:0:20235:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788851282.923661:0:20235:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788851282.923695:0:20235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923714:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c3e expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923722:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c4c expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923728:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206c8b expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923736:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206de9 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923746:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e41 expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923753:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eb1 expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923782:0:20235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923825:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eb1 expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923841:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eb1 expref: 12 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851282.923854:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88268700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817088:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851282.923970:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e41 expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851282.923978:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e41 expref: 12 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851282.923997:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817216:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851282.926628:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00010000:00010000:1.0:1788851282.928586:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206de9 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.928606:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206de9 expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851282.928622:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817344:0@lo:104: 00000100:00100000:1.0:1788851282.928678:0:20235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851282.928713:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019817344 00000100:00100000:1.0:1788851282.928721:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019817344 00000100:00100000:1.0:1788851282.928766:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788851282.928774:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:20235:x1875746019817344:12345-0@lo:104: 00010000:00010000:1.0:1788851282.928787:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.928828:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788851282.928834:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:20235:x1875746019817344:12345-0@lo:104: Request processed in 61us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851282.928841:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788851282.928949:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206c8b expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.928976:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206c8b expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851282.928986:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817472:0@lo:104: 00000100:00100000:1.0:1788851282.929010:0:20235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851282.929046:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019817472 00000100:00100000:1.0:1788851282.929050:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019817472 00000100:00100000:1.0:1788851282.929069:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851282.929075:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:20235:x1875746019817472:12345-0@lo:104: 00010000:00010000:1.0:1788851282.929083:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929114:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788851282.929120:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:20235:x1875746019817472:12345-0@lo:104: Request processed in 46us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851282.929126:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788851282.929143:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851282.929150:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929158:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031000 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851282.929163:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929172:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851282.929180:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851282.929193:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851282.929681:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929693:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851282.929716:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929723:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031000/0x3e0030720b206de9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206df0 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929739:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851282.929742:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929747:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8e00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851282.929750:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929758:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851282.929764:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851282.929769:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851282.929785:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929791:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851282.929812:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929818:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8e00/0x3e0030720b206c8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c92 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.929827:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851282.929828:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851282.929830:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851282.929839:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851282.929850:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019817728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851282.930379:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851282.931346:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851282.935265:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206c4c expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.935283:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206c4c expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851282.935307:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817856:0@lo:104: 00000100:00100000:1.0:1788851282.935421:0:20235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851282.935450:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019817856 00000100:00100000:1.0:1788851282.935458:0:17195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019817856 00000100:00100000:1.0:1788851282.935525:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851282.935535:0:17195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:20235:x1875746019817856:12345-0@lo:104: 00010000:00010000:1.0:1788851282.935549:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.935601:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788851282.935607:0:17195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a8a82bd-f416-4736-bb65-b562856c988b+3:20235:x1875746019817856:12345-0@lo:104: Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851282.935630:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788851282.935661:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b206c3e expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.935670:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b206c3e expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851282.935679:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88286d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817984:0@lo:104: 00000100:00100000:1.0:1788851282.935701:0:20235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851282.935712:0:20235:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e4e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788851282.935736:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88268700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817088:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851282.935744:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817216:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851282.935754:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817344:0@lo:104: 00000100:00100000:1.0:1788851282.935777:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817472:0@lo:104: 00000100:00100000:1.0:1788851282.935783:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817856:0@lo:104: 00000100:00100000:3.0:1788851282.936090:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019817984 00000100:00100000:3.0:1788851282.936095:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019817984 00000100:00100000:3.0:1788851282.936125:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788851282.936132:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+3:20235:x1875746019817984:12345-0@lo:104: 00010000:00010000:3.0:1788851282.936142:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936197:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788851282.936202:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a8a82bd-f416-4736-bb65-b562856c988b+3:20235:x1875746019817984:12345-0@lo:104: Request processed in 72us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851282.936209:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788851282.936306:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851282.936313:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936321:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9800 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851282.936326:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936335:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851282.936342:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851282.936347:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788851282.936446:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936454:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851282.936473:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936480:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9800/0x3e0030720b206c4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c53 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936503:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851282.936506:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936511:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bde00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851282.936514:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851282.936518:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88286d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875746019817984:0@lo:104: 00010000:00010000:3.0:1788851282.936521:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851282.936526:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851282.936531:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788851282.936544:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936549:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851282.936549:0:20235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936557:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936563:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea55bde00/0x3e0030720b206c3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b206c45 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.936577:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851282.936579:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851282.936580:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851282.936592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019818112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851282.936629:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851282.936676:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858240 00000100:00100000:0.0:1788851282.936681:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858240 00010000:00010000:0.0:1788851282.936704:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eb1 expref: 13 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851282.936800:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019817728 00000100:00100000:2.0:1788851282.936805:0:18367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019817728 00010000:00010000:2.0:1788851282.936823:0:18367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c8b expref: 24 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851282.936844:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1788851282.936850:0:18367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2408:x1875746000858240:12345-192.168.204.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788851282.936923:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019818112 00000100:00100000:3.0:1788851282.936928:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019818112 00010000:00010000:3.0:1788851282.936942:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c4c expref: 25 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851282.936964:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851282.936972:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+25:3648:x1875746019817728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851282.937076:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851282.937083:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c8b expref: 25 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.937094:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206c8b expref: 25 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.937108:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea55bd000/0x3e0030720b206c92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206c8b expref: 25 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.937119:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851282.937120:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851282.937125:0:18367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eb1 expref: 13 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.937135:0:18367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eb1 expref: 13 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.937146:0:18367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebb200/0x3e0030720b206f7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eb1 expref: 13 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.937155:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851282.937159:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+24:3648:x1875746019817728:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (6781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851282.937165:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851282.937178:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851282.937184:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+23:3648:x1875746019818112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851282.937192:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788851282.937192:0:18367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:2408:x1875746000858240:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 342us (10576us total) trans 0 rc 0/0 00010000:00010000:3.0:1788851282.937196:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c4c expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851282.937198:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00010000:00010000:3.0:1788851282.937204:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206c4c expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.937214:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851282.937220:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e8a8b8200/0x3e0030720b206c53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206c4c expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851282.937309:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851282.937334:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+22:3648:x1875746019818112:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851282.937339:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851282.937468:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019818112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851282.937478:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019817728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851282.937571:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019817600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851282.937604:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851282.937631:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851282.937637:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019818240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851282.937659:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851282.937734:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019817600 00000100:00100000:1.0:1788851282.937734:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019818240 00000100:00100000:2.0:1788851282.937739:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019817600 00000100:00100000:1.0:1788851282.937739:0:18367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019818240 00010000:00010000:1.0:1788851282.937755:0:18367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c3e expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.937766:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206de9 expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851282.937788:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851282.937795:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+23:3650:x1875746019817600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851282.937802:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851282.937806:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206de9 expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.937814:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206de9 expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.937824:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433da00/0x3e0030720b206df0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206de9 expref: 23 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.937832:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851282.937995:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+22:3650:x1875746019817600:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851282.938001:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851282.938030:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851282.938037:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+21:3650:x1875746019818240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851282.938043:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851282.938049:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b206c3e expref: 21 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.938056:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b206c3e expref: 21 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.938075:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e8a8b8400/0x3e0030720b206c45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b206c3e expref: 21 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.938084:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851282.938106:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a8a82bd-f416-4736-bb65-b562856c988b+20:3650:x1875746019818240:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851282.938112:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788851282.944045:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019818240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851282.944064:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019817600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851282.944517:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851282.944630:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858368 00000100:00100000:2.0:1788851282.944637:0:18367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858368 00010000:00010000:2.0:1788851282.944671:0:18367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e41 expref: 12 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851282.944712:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:2.0:1788851282.944721:0:18367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:2407:x1875746000858368:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851282.944752:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851282.944758:0:18367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e41 expref: 12 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944771:0:18367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e41 expref: 12 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944788:0:18367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94400/0x3e0030720b206f40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e41 expref: 12 pid: 17207 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944802:0:18367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944811:0:18367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944845:0:18367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944852:0:18367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944859:0:18367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944866:0:18367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944873:0:18367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eeba200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851282.944877:0:18367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944884:0:18367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944900:0:18367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851282.944910:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851282.944961:0:18367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:2407:x1875746000858368:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 241us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851282.944969:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00010000:00010000:1.0:1788851282.945808:0:20235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.945821:0:20235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851282.945829:0:20235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eeba200/0x3e0030720b206fb0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851283.767682:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851283.896738:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851283.896762:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019818368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851283.896842:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851283.896888:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019818368 00000100:00100000:0.0:1788851283.896896:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019818368 00000100:00100000:0.0:1788851283.896949:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788851283.896958:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019818368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851283.896991:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788851283.897059:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019818368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851283.897066:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788851283.897087:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851283.897124:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019818368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851283.899495:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019818496:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.899565:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.899622:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019819008:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.899648:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.899664:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019819520:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.899686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.899709:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788851283.899716:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019818624:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.900140:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.900159:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019819136:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.900183:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.900208:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019819648:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.900229:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.900271:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019818752:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.900320:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.900339:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019819264:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.900365:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.900381:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019819776:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.900402:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.900420:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788851283.900426:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019818880:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.900447:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.900462:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019819392:0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.900811:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019818496 00000100:00100000:2.0:1788851283.900820:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019818496 00000100:00100000:2.0:1788851283.900870:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788851283.900879:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+20:3647:x1875746019818496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.900952:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+20:3647:x1875746019818496:12345-0@lo:400:kworker.0 Request processed in 74us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851283.900961:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788851283.900997:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019819008 00000100:00100000:2.0:1788851283.901001:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019819008 00000100:00100000:2.0:1788851283.901042:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019818624 00000100:00100000:2.0:1788851283.901046:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019818624 00000100:00100000:2.0:1788851283.901060:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788851283.901067:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019819008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.901101:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019819008:12345-0@lo:400:kworker.0 Request processed in 35us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851283.901107:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788851283.901120:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788851283.901126:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019818624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.901153:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019818624:12345-0@lo:400:kworker.0 Request processed in 28us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851283.901158:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788851283.901178:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019819520 00000100:00100000:2.0:1788851283.901182:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019819520 00000100:00100000:2.0:1788851283.901212:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019819648 00000100:00100000:2.0:1788851283.901215:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019819648 00000100:00100000:2.0:1788851283.901227:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019819776 00000100:00100000:2.0:1788851283.901230:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019819776 00000100:00100000:2.0:1788851283.901242:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019818880 00000100:00100000:2.0:1788851283.901245:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019818880 00000100:00100000:2.0:1788851283.901258:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788851283.901264:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019819520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.901306:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019819520:12345-0@lo:400:kworker.0 Request processed in 42us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851283.901319:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788851283.901331:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788851283.901337:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019819648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.901366:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019819648:12345-0@lo:400:kworker.0 Request processed in 29us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851283.901372:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788851283.901382:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788851283.901388:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019819776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.901413:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019819776:12345-0@lo:400:kworker.0 Request processed in 25us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851283.901418:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788851283.901428:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788851283.901434:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019818880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.901459:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019818880:12345-0@lo:400:kworker.0 Request processed in 26us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851283.901465:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788851283.901527:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019818624:0@lo:400:kworker.0 00010000:00080000:2.0:1788851283.901541:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd4000 x1875746019819648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851283.901551:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019819648:0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.901560:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019818496:0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.901569:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019819008:0@lo:400:kworker.0 00000100:00100000:2.0:1788851283.901579:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019819520:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.902074:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.902105:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019819904:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.902134:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851283.902157:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019819776:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.902172:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019818880:0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.902192:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019819392 00000100:00100000:3.0:1788851283.902196:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019819392 00000100:00100000:3.0:1788851283.902219:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019819904 00000100:00100000:3.0:1788851283.902222:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019819904 00000100:00100000:3.0:1788851283.902237:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788851283.902243:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019819392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.902298:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019819392:12345-0@lo:400:kworker.0 Request processed in 54us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851283.902314:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788851283.902327:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788851283.902340:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019819904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851283.902367:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019819904:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851283.902372:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788851283.902400:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019819392:0@lo:400:kworker.0 00010000:00080000:3.0:1788851283.902409:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd6d80 x1875746019819904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851283.902418:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019819904:0@lo:400:kworker.0 00000100:00100000:1.0:1788851283.912919:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019819136 00000100:00100000:1.0:1788851283.912936:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019819136 00000100:00100000:1.0:1788851283.912996:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019818752 00000100:00100000:1.0:1788851283.913000:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019818752 00000100:00100000:1.0:1788851283.913032:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019819264 00000100:00100000:1.0:1788851283.913036:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019819264 00000100:00100000:1.0:1788851283.913058:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788851283.913068:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019819136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851283.913173:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019819136:12345-0@lo:400:kworker.0 Request processed in 106us (12988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851283.913181:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788851283.913199:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788851283.913205:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019818752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851283.913240:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019818752:12345-0@lo:400:kworker.0 Request processed in 35us (12931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851283.913245:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788851283.913255:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788851283.913261:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea1d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019819264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851283.913316:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea1d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019819264:12345-0@lo:400:kworker.0 Request processed in 56us (12950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851283.913322:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788851283.914079:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019818752:0@lo:400:kworker.0 00000100:00100000:1.0:1788851283.914095:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019819264:0@lo:400:kworker.0 00000100:00100000:1.0:1788851283.914135:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019819136:0@lo:400:kworker.0 00000100:00100000:1.0:1788851283.914308:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019820032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851283.914358:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851283.914406:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019820032 00000100:00100000:1.0:1788851283.914412:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019820032 00000100:00100000:1.0:1788851283.914448:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788851283.914456:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019820032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851283.914472:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788851283.914514:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019820032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851283.914520:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788851283.914556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019820032:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788851283.914607:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851283.914612:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851283.914615:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851283.914617:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851284.404864:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851284.404892:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019820160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851284.404972:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851284.405206:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019820160 00000100:00100000:1.0:1788851284.405217:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019820160 00000100:00100000:1.0:1788851284.405283:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788851284.405293:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019820160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851284.405337:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851284.405388:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019820160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851284.405396:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788851284.405510:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019820160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851284.534596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851284.534664:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858496 00000100:00100000:3.0:1788851284.534681:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858496 00000100:00100000:3.0:1788851284.534766:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00100000:3.0:1788851284.534777:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:14946:x1875746000858496:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851284.534795:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851284.534815:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433dc00/0x3e0030720b206fb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ee9 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.534851:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433dc00/0x3e0030720b206fb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee9 expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.534872:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433dc00/0x3e0030720b206fb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee9 expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.534881:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433dc00, rc 0) 00000100:00100000:3.0:1788851284.534952:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:14946:x1875746000858496:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 177us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851284.534959:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 148 00000100:00100000:2.0:1788851284.552999:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851284.553069:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858624 00000100:00100000:2.0:1788851284.553079:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858624 00000100:00100000:2.0:1788851284.553133:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:2.0:1788851284.553144:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:14946:x1875746000858624:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851284.553321:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:14946:x1875746000858624:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 178us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851284.553329:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 149 00000100:00100000:3.0:1788851284.555483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851284.555917:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858752 00000100:00100000:1.0:1788851284.555929:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858752 00000100:00100000:1.0:1788851284.555984:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:1.0:1788851284.555995:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:14946:x1875746000858752:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.556158:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:14946:x1875746000858752:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 164us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851284.556166:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 150 00000100:00100000:2.0:1788851284.567989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851284.568992:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858880 00000100:00100000:3.0:1788851284.569004:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858880 00000100:00100000:3.0:1788851284.569105:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:3.0:1788851284.569116:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:14946:x1875746000858880:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851284.569132:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851284.569151:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433d000/0x3e0030720b206fbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ef0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.569183:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d000/0x3e0030720b206fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ef0 expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.569195:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433d000/0x3e0030720b206fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ef0 expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.569204:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d000, rc 0) 00000100:00100000:3.0:1788851284.569288:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:14946:x1875746000858880:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 173us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851284.569296:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 151 00000100:00100000:3.0:1788851284.572006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851284.572086:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859008 00000100:00100000:2.0:1788851284.572101:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859008 00000100:00100000:2.0:1788851284.572159:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00100000:2.0:1788851284.572170:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:14946:x1875746000859008:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851284.572343:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:14946:x1875746000859008:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 174us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851284.572351:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 152 00000100:00100000:3.0:1788851284.575343:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851284.576947:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859136 00000100:00100000:1.0:1788851284.576962:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859136 00000100:00100000:1.0:1788851284.577066:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 153 00000100:00100000:1.0:1788851284.577076:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:14946:x1875746000859136:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.577242:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:14946:x1875746000859136:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 167us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851284.577252:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 153 10000000:01000000:0.0:1788851284.596081:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851284.596089:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892d875ec800 from 13 10000000:01000000:0.0:1788851284.596095:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851284.596143:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851284.596155:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851284.596167:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851284.596194:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851284.596278:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851284.596336:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89c64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851284.596463:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019820288 00000100:00100000:1.0:1788851284.596471:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019820288 00000100:00100000:1.0:1788851284.596528:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788851284.596538:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+20:17209:x1875746019820288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851284.596553:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851284.596567:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827eae00/0x3e0030720b206fcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206fc5 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.596609:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827eae00/0x3e0030720b206fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206fc5 expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.596620:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827eae00/0x3e0030720b206fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206fc5 expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.596629:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827eae00, rc 0) 00000100:00100000:1.0:1788851284.596669:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+21:17209:x1875746019820288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851284.596676:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788851284.596716:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851284.596729:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.596739:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851284.596806:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.596829:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851284.596842:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851284.596854:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019820416 00000100:00100000:1.0:1788851284.596857:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019820416 00000100:00100000:1.0:1788851284.596878:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788851284.596884:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:17209:x1875746019820416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.596992:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:17209:x1875746019820416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851284.597008:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788851284.597063:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.597090:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.597131:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851284.597150:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851284.597161:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019820544 00000100:00100000:1.0:1788851284.597164:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019820544 00000100:00100000:1.0:1788851284.597184:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788851284.597190:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:17209:x1875746019820544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.597252:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:17209:x1875746019820544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851284.597259:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788851284.597302:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788851284.600979:0:20312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788851284.601305:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788851284.601386:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851284.601399:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.601417:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851284.601428:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788851284.601430:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892ea4305000 from 13 10000000:01000000:1.0:1788851284.601433:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851284.601470:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.601494:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.601506:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851284.601537:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.601609:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851284.601653:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851284.601698:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019820672 00000100:00100000:3.0:1788851284.601705:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019820672 00000100:00100000:3.0:1788851284.601748:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788851284.601756:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+21:17209:x1875746019820672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851284.601770:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851284.601782:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433c600/0x3e0030720b206fda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206fd3 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.601813:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433c600/0x3e0030720b206fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206fd3 expref: 22 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.601824:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433c600/0x3e0030720b206fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206fd3 expref: 22 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.601833:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433c600, rc 0) 00000100:00100000:3.0:1788851284.601870:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+22:17209:x1875746019820672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851284.601877:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788851284.601960:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851284.601974:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.601983:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851284.602104:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.602132:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851284.602155:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851284.602351:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019820800 00000100:00100000:3.0:1788851284.602355:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019820800 00000100:00100000:3.0:1788851284.602388:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788851284.602395:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+22:17209:x1875746019820800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851284.602508:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+22:17209:x1875746019820800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851284.602515:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788851284.602627:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.602652:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.602693:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851284.602719:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851284.602935:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019820928 00000100:00100000:3.0:1788851284.602941:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019820928 00000100:00100000:3.0:1788851284.602973:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788851284.602980:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+22:17209:x1875746019820928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851284.603093:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+22:17209:x1875746019820928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851284.603155:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019820928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851284.603313:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000040:00080000:3.0:1788851284.603997:0:20313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788851284.604706:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788851284.604727:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851284.604738:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851284.604814:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851284.604825:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788851284.604828:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892eb6cf0800 from 13 10000000:01000000:2.0:1788851284.604830:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851284.604988:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851284.604997:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851284.605009:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851284.605345:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788851284.605414:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851284.605454:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e909139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851284.605608:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019821056 00000100:00100000:0.0:1788851284.605626:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019821056 00000100:00100000:0.0:1788851284.605691:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788851284.605702:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+22:17209:x1875746019821056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851284.605715:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851284.605730:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eeba800/0x3e0030720b206fe8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206fe1 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851284.605758:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eeba800/0x3e0030720b206fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206fe1 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851284.605770:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eeba800/0x3e0030720b206fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206fe1 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851284.605789:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eeba800, rc 0) 00000100:00100000:0.0:1788851284.605841:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019821056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851284.605848:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788851284.606341:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851284.606359:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851284.606371:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851284.606436:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851284.606473:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851284.606508:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851284.606836:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019821184 00000100:00100000:3.0:1788851284.606843:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019821184 00000100:00100000:3.0:1788851284.606896:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788851284.607170:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019821184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851284.607326:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019821184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851284.607334:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788851284.607416:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851284.607453:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851284.607505:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851284.607658:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6da7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851284.607702:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019821312 00000100:00100000:3.0:1788851284.607707:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019821312 00000100:00100000:3.0:1788851284.607742:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788851284.607751:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019821312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851284.608094:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019821312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 343us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851284.608101:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788851284.608189:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788851284.611063:0:20315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788851284.613668:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788851284.613705:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851284.613717:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851284.613732:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851284.613742:0:17209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788851284.613745:0:17209:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e84cde000 from 13 10000000:01000000:2.0:1788851284.613747:0:17209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851284.613789:0:17209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851284.613798:0:17209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851284.613810:0:17209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851284.613836:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788851284.613906:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851284.613946:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851284.614223:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019821440 00000100:00100000:1.0:1788851284.614236:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019821440 00000100:00100000:1.0:1788851284.614295:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788851284.614303:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+23:17209:x1875746019821440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851284.614318:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851284.614329:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827ea200/0x3e0030720b206ff6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b206fef expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.614352:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827ea200/0x3e0030720b206ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b206fef expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.614363:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827ea200/0x3e0030720b206ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b206fef expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.614370:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827ea200, rc 0) 00000100:00100000:1.0:1788851284.614413:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:17209:x1875746019821440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851284.614420:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788851284.614469:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851284.614483:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851284.614491:0:17209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851284.614690:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851284.614717:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851284.614749:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e86ca1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851284.615706:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019821568 00000100:00100000:0.0:1788851284.615716:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019821568 00000100:00100000:0.0:1788851284.615765:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788851284.615773:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+24:17209:x1875746019821568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851284.616040:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8a82bd-f416-4736-bb65-b562856c988b+24:17209:x1875746019821568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851284.616048:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788851284.616129:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851284.616171:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851284.616222:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851284.616254:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81acbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851284.616306:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019821696 00000100:00100000:0.0:1788851284.616311:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019821696 00000100:00100000:0.0:1788851284.616534:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788851284.616543:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:17209:x1875746019821696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851284.616643:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:17209:x1875746019821696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851284.616651:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788851284.616715:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a8a82bd-f416-4736-bb65-b562856c988b:17209:1875746019821696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788851284.617431:0:20316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788851284.617482:0:17209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788851284.617503:0:17209:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788851284.617511:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851284.617522:0:17209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851284.789968:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851284.916295:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019821824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851284.916367:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851284.916657:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019821824 00000100:00100000:2.0:1788851284.916668:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019821824 00000100:00100000:2.0:1788851284.916723:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788851284.916733:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019821824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788851284.916767:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788851284.916943:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019821824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 210us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851284.916952:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788851284.917110:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019821824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851284.917172:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851284.917181:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019821952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851284.917224:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851284.917292:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019821952 00000100:00100000:2.0:1788851284.917297:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019821952 00000100:00100000:2.0:1788851284.917362:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788851284.917369:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019821952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851284.917390:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851284.917434:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019821952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851284.917440:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788851284.917498:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019821952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788851285.812316:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851286.465286:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851286.465322:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019822080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851286.465431:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851286.467138:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019822080 00000100:00100000:0.0:1788851286.467160:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019822080 00000100:00100000:0.0:1788851286.467291:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788851286.467308:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019822080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851286.467353:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788851286.467500:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851286.467857:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019822080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 555us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851286.467866:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788851286.469704:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019822080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851286.568119:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851286.569879:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859264 00000100:00100000:1.0:1788851286.569902:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859264 00000100:00100000:1.0:1788851286.570068:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:1.0:1788851286.570083:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:15613:x1875746000859264:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851286.570110:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851286.570163:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b206ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ef7 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.570289:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.570509:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.570529:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.570550:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.570559:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.570567:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.570708:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea800/0x3e0030720b207012 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.570717:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea800/0x3e0030720b207012 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788851286.570976:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788851286.571273:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea800/0x3e0030720b207012 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851286.572596:0:18245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788851286.572607:0:18245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851286.572686:0:18245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea800/0x3e0030720b207012 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.572709:0:18245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.572718:0:18245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573008:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573044:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eb400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851286.573050:0:18245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573062:0:18245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573083:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8b00) 00010000:00010000:1.0:1788851286.573110:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851286.573117:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573125:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e827eb400/0x3e0030720b207004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573650:0:18245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573660:0:18245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573667:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573672:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851286.573675:0:18245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573682:0:18245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573693:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff892e8af96600) 00010000:00010000:1.0:1788851286.573696:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851286.573699:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.573705:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea000/0x3e0030720b20700b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.574006:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b206ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ef7 expref: 8 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.575304:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea800/0x3e0030720b207012 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ef7 expref: 7 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.575314:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff892e8af96100) 00010000:00010000:1.0:1788851286.575317:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851286.575321:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827ea800, rc 0) 00000100:00100000:1.0:1788851286.575452:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:15613:x1875746000859264:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 5371us (7347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851286.575466:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1788851286.583112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.583688:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859392 00000100:00100000:3.0:1788851286.583705:0:17223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859392 00000100:00100000:3.0:1788851286.583820:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1788851286.583834:0:17223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:15613:x1875746000859392:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788851286.583964:0:17223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:15613:x1875746000859392:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 Request processed in 133us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.583974:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1788851286.594992:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851286.595142:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859648 00000100:00100000:2.0:1788851286.595153:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859648 00000100:00100000:2.0:1788851286.595313:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1788851286.595324:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:15613:x1875746000859648:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851286.595348:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851286.595373:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207019 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38efe expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595468:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595484:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595498:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595561:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595569:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595576:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595691:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b20702e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595700:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b20702e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595707:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b20702e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851286.595717:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788851286.595868:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595886:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595893:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595899:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851286.595903:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595911:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595924:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff892e8af96100) 00010000:00010000:2.0:1788851286.595927:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851286.595932:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595938:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207020 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595953:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595959:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595965:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595970:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851286.595980:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595987:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.595995:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff892ea55ec400) 00010000:00010000:2.0:1788851286.595998:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851286.596001:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.596006:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94000/0x3e0030720b207027 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.597976:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207019 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38efe expref: 10 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.598001:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b20702e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38efe expref: 9 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.598009:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892ea55ec600) 00010000:00010000:2.0:1788851286.598027:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851286.598031:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94a00, rc 0) 00000100:00100000:2.0:1788851286.599485:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:15613:x1875746000859648:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 4149us (4489us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788851286.599498:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1788851286.612644:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.612893:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859776 00000100:00100000:0.0:1788851286.612903:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859776 00000100:00100000:0.0:1788851286.612973:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1788851286.612983:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:15613:x1875746000859776:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788851286.613123:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:15613:x1875746000859776:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 141us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851286.613148:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:3.0:1788851286.620854:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.620959:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859904 00000100:00100000:0.0:1788851286.620970:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859904 00000100:00100000:0.0:1788851286.621126:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:0.0:1788851286.621137:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:15613:x1875746000859904:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788851286.625812:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788851286.627410:0:17213:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6219us 00000100:00100000:2.0:1788851286.634513:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.635398:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860032 00000100:00100000:0.0:1788851286.635413:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860032 00000100:00100000:0.0:1788851286.635528:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1788851286.635538:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:15619:x1875746000860032:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851286.635559:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851286.635580:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20703c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f05 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635665:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635681:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635694:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635731:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635739:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635760:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635807:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635814:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635822:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635828:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851286.635833:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635843:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635856:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8b00) 00010000:00010000:0.0:1788851286.635859:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851286.635864:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635871:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207043 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635886:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635892:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635904:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635909:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bde00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851286.635912:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635918:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635925:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff892ec1d49500) 00010000:00010000:0.0:1788851286.635927:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851286.635930:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635935:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20704a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635970:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20703c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f05 expref: 10 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635980:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8b00) 00010000:00010000:0.0:1788851286.635982:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851286.635986:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20703c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f05 expref: 10 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.635997:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eeba200, rc 0) 00000100:00100000:0.0:1788851286.636094:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:15619:x1875746000860032:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 557us (1594us total) trans 0 rc 301/301 00000100:00100000:0.0:1788851286.636110:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:3.0:1788851286.640458:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.640531:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860160 00000100:00100000:3.0:1788851286.640542:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860160 00000100:00100000:3.0:1788851286.640593:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1788851286.640606:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:15619:x1875746000860160:12345-192.168.204.27@tcp:700:lfs.0 00000100:00100000:3.0:1788851286.640726:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:15619:x1875746000860160:12345-192.168.204.27@tcp:700:lfs.0 Request processed in 121us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.640735:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:2.0:1788851286.642904:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.642989:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860416 00000100:00100000:0.0:1788851286.642999:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860416 00000100:00100000:0.0:1788851286.643074:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:0.0:1788851286.643084:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:15619:x1875746000860416:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:0.0:1788851286.643149:0:17212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851286.643188:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b206f6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e72 expref: 9 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.643209:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8b00) 00010000:00010000:0.0:1788851286.643214:0:17212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851286.643298:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.643312:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee2 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.643321:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.643354:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee2 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.643367:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee2 expref: 5 pid: 17212 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851286.643381:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17212:1875746019822208:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851286.643491:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e98353240 going to sleep for 11 seconds 00000100:00100000:3.0:1788851286.646793:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851286.646873:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860544 00000100:00100000:1.0:1788851286.646884:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860544 00010000:00010000:1.0:1788851286.646940:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee2 expref: 6 pid: 17212 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851286.646977:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1788851286.646987:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2407:x1875746000860544:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851286.647002:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851286.647032:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee2 expref: 6 pid: 17212 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.647047:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee2 expref: 6 pid: 17212 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.647072:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8b00) 00010000:00010000:1.0:1788851286.647077:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.647094:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.647102:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.647122:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851286.647192:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2407:x1875746000860544:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 206us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851286.647200:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:3.0:1788851286.647767:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788851286.647863:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b206fa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee2 expref: 5 pid: 17212 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851286.647881:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17212:1875746019822208:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851286.647904:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.647913:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.647918:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.647942:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.647952:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.647961:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851286.650764:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:15613:x1875746000859904:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 29616us (29907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.650779:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00010000:00010000:1.0:1788851286.651618:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651639:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651652:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851286.651681:0:17212:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1f25fe7 reply state 0000000091ef4a60 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651694:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651703:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:1.0:1788851286.651707:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788851286.651711:0:17212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788851286.651717:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788851286.651726:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651743:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651750:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651757:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851286.651763:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651771:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651783:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8b00) 00010000:00010000:1.0:1788851286.651785:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851286.651789:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651795:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b207051 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851286.651814:0:17212:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1f25fe7 reply state 0000000091ef4a60 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651822:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851286.651828:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff892ec1d49d00) 00010000:00010000:1.0:1788851286.651830:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788851286.651832:0:17212:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788851286.653707:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+10:15619:x1875746000860416:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 10612us (10802us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788851286.653721:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1788851286.736279:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.736416:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860672 00000100:00100000:0.0:1788851286.736427:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860672 00000100:00100000:0.0:1788851286.736525:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:0.0:1788851286.736541:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+10:15627:x1875746000860672:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:0.0:1788851286.736583:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851286.736609:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f0c expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.736692:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b20706d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.736707:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b20706d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.736720:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b20706d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851286.736767:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788851286.736771:0:17214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851286.736878:0:17214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b20706d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.736905:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b207066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f0c expref: 12 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.736925:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b20706d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f0c expref: 11 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.736934:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:0.0:1788851286.736937:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851286.736941:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bd200, rc 0) 00000100:00100000:0.0:1788851286.737067:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+11:15627:x1875746000860672:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 479us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851286.737074:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:0.0:1788851286.765169:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.765512:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860800 00000100:00100000:3.0:1788851286.765525:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860800 00000100:00100000:3.0:1788851286.765590:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1788851286.765600:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:15628:x1875746000860800:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851286.765640:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851286.765663:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b207074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f13 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.765728:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d200/0x3e0030720b20707b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.765742:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d200/0x3e0030720b20707b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.765756:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d200/0x3e0030720b20707b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851286.765811:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788851286.765816:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851286.765837:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d200/0x3e0030720b20707b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.765861:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b207074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f13 expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.765880:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d200/0x3e0030720b20707b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f13 expref: 6 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.765888:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:3.0:1788851286.765891:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851286.765895:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d200, rc 0) 00000100:00100000:3.0:1788851286.765964:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15628:x1875746000860800:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 365us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.765971:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1788851286.772197:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.772246:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.772282:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.772312:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.772335:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.772351:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.772370:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.772388:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.772412:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860928 00000100:00100000:3.0:1788851286.772421:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860928 00000100:00100000:3.0:1788851286.772463:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861568 00000100:00100000:3.0:1788851286.772466:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861568 00000100:00100000:3.0:1788851286.772490:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861184 00000100:00100000:3.0:1788851286.772493:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861184 00000100:00100000:3.0:1788851286.772509:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:3.0:1788851286.772518:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000861568:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851286.772597:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000861568:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 80us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.772605:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:3.0:1788851286.772623:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1788851286.772630:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000861184:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851286.772653:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000861184:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.772660:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1788851286.772672:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1788851286.772678:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:15628:x1875746000860928:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851286.772705:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851286.772724:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b207082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f1a expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.772785:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.772800:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.772814:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.772825:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.772833:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.772840:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.772918:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b207097 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.772926:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b207097 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.772934:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b207097 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851286.772972:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788851286.772982:0:17214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851286.773005:0:17214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b207097 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773043:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773051:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773058:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773064:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851286.773068:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773075:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773087:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:3.0:1788851286.773090:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851286.773096:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773102:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b207089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773114:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773120:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773137:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773143:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433ca00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851286.773146:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773152:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773160:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff892ec1d49d00) 00010000:00010000:3.0:1788851286.773162:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851286.773165:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773170:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773194:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b207082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f1a expref: 8 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773207:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b207097 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f1a expref: 7 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.773215:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:3.0:1788851286.773217:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851286.773235:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d600, rc 0) 00000100:00100000:3.0:1788851286.773259:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+7:15628:x1875746000860928:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 581us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.773274:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00080000:3.0:1788851286.773296:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851286.773678:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861312 00000100:00100000:2.0:1788851286.773684:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861312 00000100:00100000:2.0:1788851286.773718:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861824 00000100:00100000:2.0:1788851286.773720:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861824 00000100:00100000:2.0:1788851286.773731:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861440 00000100:00100000:2.0:1788851286.773733:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861440 00000100:00100000:2.0:1788851286.773742:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861696 00000100:00100000:2.0:1788851286.773745:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861696 00000100:00100000:2.0:1788851286.773757:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1788851286.773762:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000861312:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851286.773795:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000861312:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851286.773801:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1788851286.773812:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1788851286.773817:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000861824:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851286.773837:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000861824:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 20us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851286.773842:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1788851286.773851:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1788851286.773856:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000861440:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851286.773876:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000861440:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 19us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851286.773881:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1788851286.773892:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1788851286.773898:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000861696:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851286.773917:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000861696:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 20us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851286.773930:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1788851286.774141:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861056 00000100:00100000:1.0:1788851286.774163:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861056 00000100:00100000:1.0:1788851286.774202:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00100000:1.0:1788851286.774209:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2408:x1875746000861056:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851286.774248:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2408:x1875746000861056:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 39us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851286.774254:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 166 00000100:00080000:3.0:1788851286.776695:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851286.776704:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788851286.777424:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788851286.777935:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.778074:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861952 00000100:00100000:3.0:1788851286.778084:0:17223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861952 00000100:00100000:3.0:1788851286.778127:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:3.0:1788851286.778138:0:17223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:15628:x1875746000861952:12345-192.168.204.27@tcp:900:lfs.0 00000100:00100000:3.0:1788851286.778235:0:17223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:15628:x1875746000861952:12345-192.168.204.27@tcp:900:lfs.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.778242:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1788851286.782051:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.782167:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000862208 00000100:00100000:3.0:1788851286.782177:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000862208 00000100:00100000:3.0:1788851286.782248:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1788851286.782257:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+7:15628:x1875746000862208:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851286.782275:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851286.782294:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20709e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f21 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851286.782390:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788851286.782491:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20709e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f21 expref: 9 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.782504:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:3.0:1788851286.782507:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851286.782512:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20709e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f21 expref: 9 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.782543:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433ce00, rc 0) 00000100:00100000:3.0:1788851286.782611:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+8:15628:x1875746000862208:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 355us (604us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788851286.782619:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:1.0:1788851286.784921:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.785040:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000862464 00000100:00100000:0.0:1788851286.785050:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000862464 00000100:00100000:0.0:1788851286.785121:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1788851286.785132:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:328c7902-b357-4550-8a0f-a89bc9b6ec05+8:15628:x1875746000862464:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:0.0:1788851286.785193:0:18245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851286.785229:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d600/0x3e0030720b207097 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f1a expref: 8 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.785247:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:0.0:1788851286.785252:0:18245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851286.785277:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.785291:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.785301:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851286.785503:0:18245:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8b81efe reply state 00000000ddffed14 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.785516:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.785522:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:0.0:1788851286.785524:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788851286.785527:0:18245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788851286.785549:0:18245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788851286.785630:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:328c7902-b357-4550-8a0f-a89bc9b6ec05+9:15628:x1875746000862464:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 499us (715us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788851286.785637:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:1.0:1788851286.788819:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.788934:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000862720 00000100:00100000:0.0:1788851286.788944:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000862720 00000100:00100000:0.0:1788851286.788996:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1788851286.789004:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+9:15628:x1875746000862720:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1788851286.789384:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+10:15628:x1875746000862720:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 379us (572us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788851286.789392:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1788851286.793056:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.793458:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000862976 00000100:00100000:3.0:1788851286.793468:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000862976 00000100:00100000:3.0:1788851286.793547:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1788851286.793558:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+10:15628:x1875746000862976:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851286.793585:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851286.793608:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b2070b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f28 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793691:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793707:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793718:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793729:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793737:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793743:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851286.793862:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788851286.793932:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793940:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793946:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793952:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433ca00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851286.793956:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793963:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793974:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:3.0:1788851286.793977:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851286.793982:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.793988:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794001:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794007:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794074:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794080:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851286.794083:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794090:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794099:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff892ec1d49d00) 00010000:00010000:3.0:1788851286.794102:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851286.794105:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794111:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794146:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b2070b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f28 expref: 12 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794782:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:3.0:1788851286.794786:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851286.794792:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b2070b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f28 expref: 12 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.794804:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433ce00, rc 0) 00000100:00100000:3.0:1788851286.794869:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+11:15628:x1875746000862976:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1312us (1866us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788851286.794888:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:3.0:1788851286.797757:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.798418:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000863104 00000100:00100000:0.0:1788851286.798430:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000863104 00000100:00100000:0.0:1788851286.798527:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:0.0:1788851286.798539:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:328c7902-b357-4550-8a0f-a89bc9b6ec05+11:15628:x1875746000863104:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851286.798567:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851286.798591:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2070cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f2f expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.798709:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.798725:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.798737:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851286.798763:0:18245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788851286.798783:0:18245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851286.798808:0:18245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.798836:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2070cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f2f expref: 13 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.798857:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f2f expref: 12 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.798867:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:0.0:1788851286.798870:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851286.798875:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc800, rc 0) 00000100:00100000:0.0:1788851286.798936:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:328c7902-b357-4550-8a0f-a89bc9b6ec05+12:15628:x1875746000863104:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 399us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851286.798943:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:1.0:1788851286.802350:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.802511:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000863232 00000100:00100000:3.0:1788851286.802521:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000863232 00000100:00100000:3.0:1788851286.802579:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1788851286.802589:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+12:15628:x1875746000863232:12345-192.168.204.27@tcp:37:lfs.0 00000100:00100000:2.0:1788851286.808626:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+12:15628:x1875746000863232:12345-192.168.204.27@tcp:37:lfs.0 Request processed in 6028us (6277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851286.808644:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1788851286.812502:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851286.812598:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000863488 00000100:00100000:2.0:1788851286.812610:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000863488 00000100:00100000:2.0:1788851286.812707:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1788851286.812718:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+12:15628:x1875746000863488:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1788851286.812944:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+13:15628:x1875746000863488:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 227us (453us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788851286.812952:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00010000:00010000:2.0:1788851286.836628:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851286.865096:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.865185:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000863616 00000100:00100000:3.0:1788851286.865195:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000863616 00000100:00100000:3.0:1788851286.865268:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:3.0:1788851286.865279:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+11:15634:x1875746000863616:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851286.865299:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851286.865319:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b2070dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f36 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865384:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865399:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865409:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865420:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865427:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865452:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865528:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433da00/0x3e0030720b2070f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865538:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433da00/0x3e0030720b2070f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865546:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433da00/0x3e0030720b2070f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851286.865584:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788851286.865589:0:17214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851286.865629:0:17214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433da00/0x3e0030720b2070f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865642:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865649:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865656:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865662:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851286.865666:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865675:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865695:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:3.0:1788851286.865698:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851286.865702:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865709:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b2070e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865722:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865729:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865735:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865741:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433ca00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851286.865744:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865750:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865757:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff892ec1d49d00) 00010000:00010000:3.0:1788851286.865760:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851286.865762:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865768:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2070eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865801:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b2070dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f36 expref: 13 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865813:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433da00/0x3e0030720b2070f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f36 expref: 12 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.865820:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:3.0:1788851286.865822:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788851286.865824:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433da00, rc 0) 00000100:00100000:3.0:1788851286.865891:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+12:15634:x1875746000863616:12345-192.168.204.27@tcp:101:bash.0 Request processed in 614us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.865899:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:1.0:1788851286.868642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.868817:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000863744 00000100:00100000:3.0:1788851286.868827:0:17223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000863744 00000100:00100000:3.0:1788851286.868884:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851286.868893:0:17223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:15634:x1875746000863744:12345-192.168.204.27@tcp:900:bash.0 00000100:00100000:3.0:1788851286.868973:0:17223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:15634:x1875746000863744:12345-192.168.204.27@tcp:900:bash.0 Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.868981:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1788851286.871233:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851286.871515:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000864000 00000100:00100000:2.0:1788851286.871525:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000864000 00000100:00100000:2.0:1788851286.871634:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:2.0:1788851286.871645:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+12:15634:x1875746000864000:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:2.0:1788851286.871685:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851286.871707:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95600/0x3e0030720b2070f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f3d expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.871810:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.871825:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f2f expref: 12 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.871854:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.871892:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f2f expref: 12 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.871905:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f2f expref: 12 pid: 18245 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851286.871919:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17212:1875746019822336:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851286.872002:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851286.876391:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.876479:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000864128 00000100:00100000:3.0:1788851286.876493:0:17199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000864128 00010000:00010000:3.0:1788851286.876539:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f2f expref: 13 pid: 18245 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851286.876592:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1788851286.876603:0:17199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+13:2408:x1875746000864128:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851286.876633:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851286.876642:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f2f expref: 13 pid: 18245 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.876656:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f2f expref: 13 pid: 18245 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.876679:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:3.0:1788851286.876687:0:17199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.876698:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.876706:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.876726:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851286.876781:0:17199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+13:2408:x1875746000864128:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 179us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.876788:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00010000:00010000:2.0:1788851286.878413:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2070d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f2f expref: 12 pid: 18245 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851286.878437:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17212:1875746019822336:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851286.878463:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.878473:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.878480:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.878506:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.878517:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.878540:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879315:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879328:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879336:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851286.879347:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788851286.879371:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879379:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879388:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879394:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851286.879398:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879405:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879416:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:2.0:1788851286.879419:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851286.879433:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879440:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b207100 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851286.879452:0:17212:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e129e3a reply state 0000000096174466 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879462:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879468:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff892ea55ec400) 00010000:00010000:2.0:1788851286.879471:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851286.879473:0:17212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788851286.879511:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95600/0x3e0030720b2070f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f3d expref: 15 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879525:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f3d expref: 14 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851286.879532:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:2.0:1788851286.879534:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788851286.879537:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95400, rc 0) 00000100:00100000:2.0:1788851286.879605:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+15:15634:x1875746000864000:12345-192.168.204.27@tcp:101:bash.0 Request processed in 7962us (8392us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788851286.879614:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:1.0:1788851286.889771:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851286.889872:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000864256 00000100:00100000:3.0:1788851286.889883:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000864256 00000100:00100000:3.0:1788851286.889955:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:3.0:1788851286.889966:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+15:15634:x1875746000864256:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1788851286.889994:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851286.890062:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20711c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f44 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.890333:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.890349:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.890362:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851286.890414:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788851286.890418:0:17214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851286.890438:0:17214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.890448:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.890474:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20711c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f44 expref: 17 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.890494:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f44 expref: 16 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851286.890502:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851286.890506:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851286.890510:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433ca00, rc 0) 00000100:00100000:3.0:1788851286.890563:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+16:15634:x1875746000864256:12345-192.168.204.27@tcp:101:bash.0 Request processed in 599us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851286.890570:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1788851286.894374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.894846:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000864512 00000100:00100000:0.0:1788851286.894857:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000864512 00000100:00100000:0.0:1788851286.894969:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1788851286.894981:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+16:15634:x1875746000864512:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:0.0:1788851286.895457:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+17:15634:x1875746000864512:12345-192.168.204.27@tcp:35:bash.0 Request processed in 475us (1089us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788851286.895465:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1788851286.987987:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851286.988113:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000864768 00000100:00100000:0.0:1788851286.988125:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000864768 00000100:00100000:0.0:1788851286.988198:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:0.0:1788851286.988210:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+17:15644:x1875746000864768:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851286.988252:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851286.988290:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20712a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f4b expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851286.988390:0:18245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788851286.988498:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20712a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f4b expref: 19 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.988512:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:0.0:1788851286.988515:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851286.988520:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20712a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f4b expref: 19 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851286.988534:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bde00, rc 0) 00000100:00100000:0.0:1788851286.988599:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+18:15644:x1875746000864768:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 391us (621us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788851286.988606:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:1.0:1788851286.992824:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851286.993004:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000865024 00000100:00100000:2.0:1788851286.993060:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000865024 00000100:00100000:2.0:1788851286.993111:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:2.0:1788851286.993121:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+18:15644:x1875746000865024:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:2.0:1788851286.993387:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+19:15644:x1875746000865024:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 267us (573us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788851286.993395:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1788851287.026692:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851287.026779:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000865280 00000100:00100000:3.0:1788851287.026790:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000865280 00000100:00100000:3.0:1788851287.026850:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:3.0:1788851287.026860:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+19:15647:x1875746000865280:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1788851287.026885:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851287.026907:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b207138 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f52 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.027007:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b20713f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.027055:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b20713f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.027070:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b20713f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851287.027082:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788851287.027199:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b207138 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f52 expref: 22 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.027229:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b20713f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f52 expref: 21 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.027238:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851287.027249:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851287.027254:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d800, rc 0) 00000100:00100000:3.0:1788851287.027310:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+21:15647:x1875746000865280:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 451us (629us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788851287.027332:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:1.0:1788851287.031436:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851287.031483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851287.031592:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000865408 00000100:00100000:0.0:1788851287.031602:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000865408 00000100:00100000:0.0:1788851287.031673:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:0.0:1788851287.031683:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+21:15647:x1875746000865408:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:0.0:1788851287.031756:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.031777:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.031791:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.031851:0:18245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.031859:0:18245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.031867:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.031873:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bde00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851287.031877:0:18245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.031885:0:18245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.031898:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:0.0:1788851287.031901:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851287.031907:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.031914:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b20714d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851287.031993:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+21:15647:x1875746000865408:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 311us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851287.032002:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:1.0:1788851287.035051:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851287.035163:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000865792 00000100:00100000:3.0:1788851287.035174:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000865792 00000100:00100000:3.0:1788851287.035234:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851287.035254:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+21:15647:x1875746000865792:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851287.035474:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+22:15647:x1875746000865792:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 230us (463us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788851287.035481:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1788851287.038439:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000865536 00000100:00100000:2.0:1788851287.038454:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000865536 00000100:00100000:2.0:1788851287.038523:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:2.0:1788851287.038533:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+22:2410:x1875746000865536:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851287.038549:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851287.038578:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d800/0x3e0030720b20713f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f52 expref: 22 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851287.038598:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:2.0:1788851287.038605:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851287.038689:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+21:2410:x1875746000865536:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 156us (7204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851287.038697:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000040:00080000:2.0:1788851287.157088:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788851287.307705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851287.307792:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000866048 00000100:00100000:3.0:1788851287.307802:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000866048 00000100:00100000:3.0:1788851287.307865:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:3.0:1788851287.307875:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+21:15678:x1875746000866048:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:3.0:1788851287.307899:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851287.307920:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b207154 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f59 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.308075:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433cc00/0x3e0030720b20715b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.308091:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433cc00/0x3e0030720b20715b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.308102:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433cc00/0x3e0030720b20715b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851287.308113:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788851287.308255:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b207154 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f59 expref: 24 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.308293:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433cc00/0x3e0030720b20715b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f59 expref: 23 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.308302:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851287.308305:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851287.308309:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433cc00, rc 0) 00000100:00100000:3.0:1788851287.308355:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+23:15678:x1875746000866048:12345-192.168.204.27@tcp:101:cat.0 Request processed in 482us (661us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788851287.308361:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:3.0:1788851287.310808:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851287.311592:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851287.311674:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000866432 00000100:00100000:3.0:1788851287.311684:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000866432 00000100:00100000:3.0:1788851287.311736:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1788851287.311746:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+23:15678:x1875746000866432:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:3.0:1788851287.311994:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+24:15678:x1875746000866432:12345-192.168.204.27@tcp:35:cat.0 Request processed in 249us (404us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788851287.312001:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1788851287.315613:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000866176 00000100:00100000:2.0:1788851287.315629:0:17199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000866176 00000100:00100000:2.0:1788851287.315976:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:2.0:1788851287.315987:0:17199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+24:2408:x1875746000866176:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851287.316005:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851287.316058:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433cc00/0x3e0030720b20715b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f59 expref: 24 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851287.316080:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:2.0:1788851287.316101:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851287.316174:0:17199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+23:2408:x1875746000866176:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 189us (5373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851287.316182:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1788851287.360569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851287.360793:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000866688 00000100:00100000:0.0:1788851287.360806:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000866688 00000100:00100000:0.0:1788851287.360876:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:0.0:1788851287.360909:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+23:15684:x1875746000866688:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1788851287.360948:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851287.360973:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b207169 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f60 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.361134:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.361254:0:18245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f3d expref: 24 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.361262:0:18245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f44 expref: 24 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.361271:0:18245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.361308:0:18245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f44 expref: 24 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.361321:0:18245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f44 expref: 24 pid: 17214 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851287.361333:0:18245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019822464:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851287.361466:0:18245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f3d expref: 24 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.361476:0:18245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f3d expref: 24 pid: 17212 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851287.361495:0:18245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88269180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019822592:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851287.361523:0:18245:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90913840 going to sleep for 11 seconds 00000100:00100000:1.0:1788851287.365099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851287.365194:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851287.365409:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000866816 00000100:00100000:3.0:1788851287.365418:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000866816 00010000:00010000:3.0:1788851287.365460:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f44 expref: 25 pid: 17214 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851287.365496:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000866944 00000100:00100000:3.0:1788851287.365500:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000866944 00010000:00010000:3.0:1788851287.365513:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f3d expref: 26 pid: 17212 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851287.365552:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1788851287.365561:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+26:2407:x1875746000866816:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851287.365575:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851287.365581:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f44 expref: 26 pid: 17214 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365591:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f44 expref: 26 pid: 17214 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365612:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b207123 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f44 expref: 26 pid: 17214 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365627:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851287.365632:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365641:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365703:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851287.365752:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+25:2407:x1875746000866816:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 191us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851287.365759:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:3.0:1788851287.365778:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:3.0:1788851287.365785:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+24:2407:x1875746000866944:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851287.365800:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851287.365805:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f3d expref: 24 pid: 17212 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365813:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f3d expref: 24 pid: 17212 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365825:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851287.365829:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365836:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365843:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.365860:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851287.365878:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+24:2407:x1875746000866944:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 94us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851287.365885:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1788851287.366226:0:18245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019822464:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851287.366253:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95400/0x3e0030720b20710e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f3d expref: 23 pid: 17212 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851287.366268:0:18245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88269180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019822592:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851287.366289:0:18245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.366298:0:18245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.366303:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851287.366322:0:18245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788851287.366481:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b207169 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f60 expref: 24 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.366495:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f60 expref: 23 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.366502:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:0.0:1788851287.366504:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788851287.366507:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea55bc200, rc 0) 00000100:00100000:0.0:1788851287.366541:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+23:15684:x1875746000866688:12345-192.168.204.27@tcp:101:dd.0 Request processed in 5637us (5988us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788851287.366548:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:3.0:1788851287.369998:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851287.370226:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000867072 00000100:00100000:0.0:1788851287.370240:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000867072 00000100:00100000:0.0:1788851287.370310:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:0.0:1788851287.370321:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+23:15684:x1875746000867072:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1788851287.370346:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851287.370368:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20717e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f67 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.370409:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.370423:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.370436:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.370572:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b20717e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f67 expref: 25 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.370598:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f67 expref: 24 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.370607:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:0.0:1788851287.370611:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851287.370614:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebac00, rc 0) 00000100:00100000:0.0:1788851287.370703:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+24:15684:x1875746000867072:12345-192.168.204.27@tcp:101:dd.0 Request processed in 383us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851287.370711:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:1.0:1788851287.373441:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851287.373521:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000867328 00000100:00100000:3.0:1788851287.373531:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000867328 00000100:00100000:3.0:1788851287.373587:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:3.0:1788851287.373595:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+24:15684:x1875746000867328:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:3.0:1788851287.374175:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.374233:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.374248:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851287.374301:0:17212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788851287.374326:0:17212:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005c2f16a reply state 00000000993648f3 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.374339:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.374346:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851287.374349:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851287.374353:0:17212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851287.374466:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+27:15684:x1875746000867328:12345-192.168.204.27@tcp:36:dd.0 Request processed in 869us (1032us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788851287.374474:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000020:00080000:3.0:1788851287.374480:0:17212:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788851287.379139:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851287.379453:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000867456 00000100:00100000:0.0:1788851287.379463:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000867456 00000100:00100000:0.0:1788851287.379559:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1788851287.379570:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+27:15684:x1875746000867456:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1788851287.379596:0:17214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851287.379618:0:17214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b207193 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f6e expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.379679:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b207193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f6e expref: 28 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.379693:0:17214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b207193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f6e expref: 28 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.379711:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:0.0:1788851287.379714:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851287.379718:0:17214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebbe00, rc 0) 00000100:00100000:0.0:1788851287.379773:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+28:15684:x1875746000867456:12345-192.168.204.27@tcp:101:dd.0 Request processed in 205us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851287.379792:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:1.0:1788851287.407935:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851287.408059:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000867712 00000100:00100000:3.0:1788851287.408069:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000867712 00000100:00100000:3.0:1788851287.408157:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:3.0:1788851287.408169:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+28:15684:x1875746000867712:12345-192.168.204.27@tcp:103:dd.0 00010000:00010000:3.0:1788851287.408190:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851287.408230:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b207193 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f6e expref: 28 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.408265:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851287.408289:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851287.408364:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+27:15684:x1875746000867712:12345-192.168.204.27@tcp:103:dd.0 Request processed in 197us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851287.408373:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1788851287.410924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851287.411000:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000867840 00000100:00100000:0.0:1788851287.411039:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000867840 00000100:00100000:0.0:1788851287.411095:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1788851287.411106:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+27:15684:x1875746000867840:12345-192.168.204.27@tcp:58:dd.0 00010000:00010000:0.0:1788851287.411245:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.411266:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851287.411279:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851287.412680:0:18245:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851287.413572:0:18245:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788851287.413703:0:18245:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788851287.413812:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+27:15684:x1875746000867840:12345-192.168.204.27@tcp:58:dd.0 Request processed in 2704us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851287.413823:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1788851287.422823:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851287.424598:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000867968 00000100:00100000:3.0:1788851287.424613:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000867968 00000100:00100000:3.0:1788851287.424687:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:3.0:1788851287.424697:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+27:15684:x1875746000867968:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:3.0:1788851287.424716:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851287.424735:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f75 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.424787:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.424797:0:17213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f75 expref: 28 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.424816:0:17213:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.424829:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f75 expref: 28 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.424843:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851287.424846:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851287.424860:0:17213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f75 expref: 28 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851287.424887:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433ca00, rc 0) 00000100:00100000:3.0:1788851287.424952:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+28:15684:x1875746000867968:12345-192.168.204.27@tcp:101:dd.0 Request processed in 256us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851287.424959:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00010000:00010000:1.0:1788851287.860528:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851288.180335:0:17246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788851288.180345:0:17246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788851288.180391:0:17246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788851288.180406:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788851288.180542:0:17246:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17246:1875746019822720:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788851288.180637:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851288.185925:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.186042:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000868096 00000100:00100000:0.0:1788851288.186052:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000868096 00000100:00100000:0.0:1788851288.186131:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:0.0:1788851288.186144:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+29:15685:x1875746000868096:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851288.186177:0:17212:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851288.186346:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+29:15685:x1875746000868096:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 204us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851288.186354:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:2.0:1788851288.186662:0:17246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17246:1875746019822720:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1788851288.188625:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851288.189866:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.190058:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000868224 00000100:00100000:0.0:1788851288.190080:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000868224 00000100:00100000:3.0:1788851288.190225:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1788851288.190238:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+28:15685:x1875746000868224:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788851288.190312:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190445:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190460:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190565:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190575:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190582:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190606:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190629:0:17214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190637:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851288.190682:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788851288.190686:0:17214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851288.190702:0:17214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190712:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190720:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190727:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190734:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851288.190738:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190746:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190757:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892ea55ec600) 00010000:00010000:3.0:1788851288.190760:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851288.190765:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190782:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b2071a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190796:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190803:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190809:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190815:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851288.190818:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190824:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190831:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff892e83031b00) 00010000:00010000:3.0:1788851288.190833:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851288.190836:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190842:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b2071af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190856:0:17214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190862:0:17214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190873:0:17214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190878:0:17214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851288.190881:0:17214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190888:0:17214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190896:0:17214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851288.190899:0:17214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851288.190901:0:17214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.190907:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b2071b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851288.190985:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+28:15685:x1875746000868224:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 749us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851288.190993:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1788851288.199207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.199518:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000868480 00000100:00100000:0.0:1788851288.199530:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000868480 00000100:00100000:0.0:1788851288.199595:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:0.0:1788851288.199603:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+28:15685:x1875746000868480:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851288.199638:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851288.199669:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b2071bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f7c expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199771:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199786:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199798:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851288.199809:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788851288.199885:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199893:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199900:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199906:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851288.199910:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199918:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199930:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:0.0:1788851288.199938:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788851288.199944:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199950:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.199991:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b2071bd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f7c expref: 30 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.200002:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892ea55ec600) 00010000:00010000:0.0:1788851288.200004:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851288.200008:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b2071bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f7c expref: 30 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.200064:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebbe00, rc 0) 00000100:00100000:0.0:1788851288.200880:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+29:15685:x1875746000868480:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 523us (943us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788851288.200890:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:1.0:1788851288.205111:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.205425:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000868608 00000100:00100000:0.0:1788851288.205437:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000868608 00000100:00100000:0.0:1788851288.205506:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:0.0:1788851288.205517:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+29:15685:x1875746000868608:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851288.205556:0:17213:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851288.205688:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+29:15685:x1875746000868608:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 172us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851288.205697:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1788851288.217752:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851288.217951:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000868864 00000100:00100000:2.0:1788851288.217961:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000868864 00000100:00100000:2.0:1788851288.218052:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:2.0:1788851288.218063:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+29:15685:x1875746000868864:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851288.218094:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851288.218114:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b2071d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f83 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851288.218877:0:18245:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1788851288.219399:0:18245:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788851288.219428:0:18245:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788851288.219906:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94e00/0x3e0030720b2071d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.219923:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94e00/0x3e0030720b2071d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.219948:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94e00/0x3e0030720b2071d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.220033:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94600/0x3e0030720b2071d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f83 expref: 32 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.220054:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94e00/0x3e0030720b2071d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f83 expref: 31 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.220062:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ea55ec000) 00010000:00010000:2.0:1788851288.223805:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851288.223828:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94e00, rc 0) 00000100:00100000:2.0:1788851288.223958:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+31:15685:x1875746000868864:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 5888us (6207us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788851288.223971:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:1.0:1788851288.231143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.231239:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000869120 00000100:00100000:0.0:1788851288.231263:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000869120 00000100:00100000:0.0:1788851288.231322:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:0.0:1788851288.231333:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+31:15685:x1875746000869120:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851288.231389:0:17213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851288.231416:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94e00/0x3e0030720b2071d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f83 expref: 31 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231433:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ea55ec000) 00010000:00010000:0.0:1788851288.231444:0:17213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851288.231466:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231491:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231501:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231516:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231524:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231531:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231578:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231585:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231597:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231604:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851288.231608:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231615:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231623:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:0.0:1788851288.231626:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851288.231630:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231635:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc800/0x3e0030720b2071e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231645:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231666:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231673:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231679:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bde00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851288.231682:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231698:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231705:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6ef583b7 (ffff892ec1d49800) 00010000:00010000:0.0:1788851288.231707:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851288.231710:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.231717:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bde00/0x3e0030720b2071ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6ef583b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851288.231798:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+30:15685:x1875746000869120:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 466us (675us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788851288.231806:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1788851288.239330:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.239416:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000869248 00000100:00100000:0.0:1788851288.239425:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000869248 00000100:00100000:0.0:1788851288.239491:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:0.0:1788851288.239501:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+30:15685:x1875746000869248:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851288.239521:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851288.239545:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b2071f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f8a expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.239600:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa000/0x3e0030720b2071fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.239613:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa000/0x3e0030720b2071fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.239625:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa000/0x3e0030720b2071fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.239740:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b2071f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f8a expref: 32 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.239759:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa000/0x3e0030720b2071fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f8a expref: 31 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.239767:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:0.0:1788851288.239770:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851288.239774:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa000, rc 0) 00000100:00100000:0.0:1788851288.239835:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+31:15685:x1875746000869248:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 335us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851288.239842:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:1.0:1788851288.244847:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.245499:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000869504 00000100:00100000:0.0:1788851288.245511:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000869504 00000100:00100000:0.0:1788851288.245575:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1788851288.245585:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+31:15685:x1875746000869504:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851288.245683:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.245700:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.245712:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851288.245874:0:17213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788851288.245882:0:17213:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622304868861ns, next at 623304866909ns, rc = 0 00000004:00010000:0.0:1788851288.245944:0:17213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428c7843 reply state 000000005b2dd6c8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.245956:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.245964:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:0.0:1788851288.245967:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788851288.245972:0:17213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851288.246083:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+33:15685:x1875746000869504:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 498us (1246us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788851288.246090:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:1.0:1788851288.253797:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.258168:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000869632 00000100:00100000:0.0:1788851288.258185:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000869632 00000100:00100000:0.0:1788851288.258279:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:0.0:1788851288.258290:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+33:15685:x1875746000869632:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851288.258317:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851288.258339:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f91 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.258402:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f91 expref: 34 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.258417:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f91 expref: 34 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.258436:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:0.0:1788851288.258439:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851288.258457:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa400, rc 0) 00000100:00100000:0.0:1788851288.258514:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+34:15685:x1875746000869632:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 226us (4728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851288.258521:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:1.0:1788851288.263590:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851288.263683:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000869760 00000100:00100000:2.0:1788851288.263693:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000869760 00000100:00100000:2.0:1788851288.263759:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1788851288.263769:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2410:x1875746000869760:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788851288.264038:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:2410:x1875746000869760:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 244us (432us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788851288.264047:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00080000:3.0:1788851288.264405:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851288.268665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851288.268780:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000870016 00000100:00100000:3.0:1788851288.268792:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000870016 00000100:00100000:3.0:1788851288.268854:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1788851288.268864:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+34:15685:x1875746000870016:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788851288.269135:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+35:15685:x1875746000870016:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 261us (479us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788851288.269161:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1788851288.272113:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851288.272260:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000870272 00000100:00100000:3.0:1788851288.272270:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000870272 00000100:00100000:3.0:1788851288.272325:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:3.0:1788851288.272334:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+35:15685:x1875746000870272:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788851288.272441:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+35:15685:x1875746000870272:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 108us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851288.272449:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1788851288.280728:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.280856:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000870400 00000100:00100000:0.0:1788851288.280865:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000870400 00000100:00100000:0.0:1788851288.280926:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:0.0:1788851288.280936:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+35:15685:x1875746000870400:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851288.280954:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851288.280975:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab400/0x3e0030720b207211 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f98 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.281078:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaba00/0x3e0030720b207218 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.281093:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaba00/0x3e0030720b207218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.281106:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaba00/0x3e0030720b207218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851288.281165:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851288.281183:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaba00/0x3e0030720b207218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.281229:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab400/0x3e0030720b207211 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f98 expref: 37 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.281249:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaba00/0x3e0030720b207218 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f98 expref: 36 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.281270:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:0.0:1788851288.281274:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788851288.281277:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaba00, rc 0) 00000100:00100000:0.0:1788851288.281332:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+36:15685:x1875746000870400:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 397us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851288.281339:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1788851288.284923:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851288.285002:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000870528 00000100:00100000:2.0:1788851288.285038:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000870528 00000100:00100000:2.0:1788851288.285092:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:2.0:1788851288.285101:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:2408:x1875746000870528:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851288.285323:0:18721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851288.285345:0:18721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38f9f expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851288.285369:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb457, blocks: 0x0 00010000:00010000:2.0:1788851288.285388:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788851288.285393:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851288.285401:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f9f expref: 7 pid: 18721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.285419:0:18721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f9f expref: 7 pid: 18721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.285433:0:18721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94600, rc 0) 00000100:00100000:2.0:1788851288.285489:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:2408:x1875746000870528:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 388us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851288.285497:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1788851288.297154:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851288.297324:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000870784 00000100:00100000:3.0:1788851288.297335:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000870784 00000100:00100000:3.0:1788851288.297396:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:3.0:1788851288.297405:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+36:15685:x1875746000870784:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788851288.297512:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+36:15685:x1875746000870784:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851288.297519:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:1.0:1788851288.301946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.302044:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000870912 00000100:00100000:0.0:1788851288.302054:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000870912 00000100:00100000:0.0:1788851288.302108:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:0.0:1788851288.302128:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+36:15685:x1875746000870912:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788851288.304077:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788851288.304093:0:17192:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788851288.304147:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788851288.306480:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851288.306503:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019822848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788851288.306575:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851288.306627:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019822848 00000100:00100000:0.0:1788851288.306635:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019822848 00000100:00100000:0.0:1788851288.306694:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788851288.306702:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019822848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788851288.306834:0:18719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788851288.306838:0:18719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788851288.306840:0:18719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788851288.306842:0:18719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788851287 -> 1788851287 00002000:00010000:0.0:1788851288.306845:0:18719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788851288.306882:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019822848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (307us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788851288.306890:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788851288.306925:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788851288.306954:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892d8826a300/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788851288.306959:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019822848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788851288.307087:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+19:15685:x1875746000870912:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 4968us (5148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851288.307095:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00010000:00010000:1.0:1788851288.307514:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.307524:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.307532:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.307549:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851288.307554:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.307561:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.307576:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:1.0:1788851288.307579:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788851288.307585:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.307592:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd000/0x3e0030720b2070ac lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311002:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311047:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311056:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311063:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bd400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851288.311069:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311077:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311112:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff892ec1d49d00) 00010000:00010000:1.0:1788851288.311115:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851288.311121:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311139:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd400/0x3e0030720b207058 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311160:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311167:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311173:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311178:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ebe00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851288.311181:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311187:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311206:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:1.0:1788851288.311208:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851288.311211:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311224:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ebe00/0x3e0030720b20705f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311251:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311257:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311263:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311267:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851288.311269:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311275:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311282:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff892ea55ec400) 00010000:00010000:1.0:1788851288.311284:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851288.311287:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311292:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95800/0x3e0030720b207107 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311305:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311310:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311315:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311327:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433ce00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851288.311331:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311337:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311346:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:1.0:1788851288.311348:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851288.311351:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311357:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ce00/0x3e0030720b20718c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311369:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311375:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311381:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311386:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851288.311389:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311395:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311414:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:1.0:1788851288.311416:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788851288.311420:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.311425:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab800/0x3e0030720b207203 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851288.311669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851288.311772:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000871040 00000100:00100000:1.0:1788851288.311782:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000871040 00000100:00100000:1.0:1788851288.311864:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:1.0:1788851288.311873:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:2410:x1875746000871040:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788851288.311975:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:2410:x1875746000871040:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851288.311983:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1788851288.319146:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851288.319413:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000871296 00000100:00100000:3.0:1788851288.319423:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000871296 00000100:00100000:3.0:1788851288.319487:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:3.0:1788851288.319498:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+15:15685:x1875746000871296:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851288.319580:0:17213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851288.319607:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaba00/0x3e0030720b207218 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f98 expref: 15 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.319628:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:3.0:1788851288.319639:0:17213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851288.319685:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.319702:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.319713:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851288.319855:0:17213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005596705f reply state 000000002a555299 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.319868:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.319874:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:3.0:1788851288.319877:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851288.319880:0:17213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851288.319991:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+16:15685:x1875746000871296:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 493us (856us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788851288.319999:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:3.0:1788851288.321863:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.321941:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000871424 00000100:00100000:0.0:1788851288.321950:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000871424 00000100:00100000:0.0:1788851288.322004:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:0.0:1788851288.322065:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:2408:x1875746000871424:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788851288.322394:0:18719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788851288.322398:0:18719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788851286 00002000:00010000:0.0:1788851288.322400:0:18719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788851286 00002000:00010000:0.0:1788851288.322403:0:18719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788851287 -> 1788851286 00002000:00010000:0.0:1788851288.322405:0:18719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788851288.322502:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+8:2408:x1875746000871424:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 489us (649us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788851288.322510:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:0.0:1788851288.326594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851288.327221:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000871552 00000100:00100000:2.0:1788851288.327233:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000871552 00000100:00100000:2.0:1788851288.327299:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1788851288.327310:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8826b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+8:2407:x1875746000871552:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788851288.327358:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.327392:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851288.327397:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851288.327404:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.327419:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.327446:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.327456:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.327466:0:18721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.327474:0:18721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851288.327479:0:18721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.327488:0:18721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.327513:0:18721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.327532:0:18721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7ebc927/0x3e0030720b20722d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851288.327882:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8826b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+8:2407:x1875746000871552:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 572us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851288.327891:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:0.0:1788851288.336967:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851288.337171:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000871808 00000100:00100000:3.0:1788851288.337183:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000871808 00000100:00100000:3.0:1788851288.337261:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:3.0:1788851288.337273:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+16:15685:x1875746000871808:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788851288.337375:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.337395:0:18245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f67 expref: 16 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.337419:0:18245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.337454:0:18245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f67 expref: 16 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.337467:0:18245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f67 expref: 16 pid: 17214 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851288.337481:0:18245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019822976:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851288.337586:0:18245:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86aad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851288.350154:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.350297:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000871936 00000100:00100000:0.0:1788851288.350310:0:17199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000871936 00010000:00010000:0.0:1788851288.350359:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f67 expref: 17 pid: 17214 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851288.350430:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1788851288.350441:0:17199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+17:2407:x1875746000871936:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851288.350458:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851288.350466:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f67 expref: 17 pid: 17214 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.350484:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f67 expref: 17 pid: 17214 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.350522:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:0.0:1788851288.350529:0:17199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f75 expref: 17 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.350541:0:17199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.350550:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.350559:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.350581:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851288.350649:0:17199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+17:2407:x1875746000871936:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 209us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851288.350657:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00010000:00010000:3.0:1788851288.354400:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b207185 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f67 expref: 16 pid: 17214 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851288.354432:0:18245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019822976:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851288.354460:0:18245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.354470:0:18245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.354477:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.354723:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.354739:0:18245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f91 expref: 16 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.354756:0:18245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.354797:0:18245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f91 expref: 16 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.354815:0:18245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f91 expref: 16 pid: 17212 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851288.354832:0:18245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019823104:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851288.354957:0:18245:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86aad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851288.359919:0:18245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019823104:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851288.359955:0:18245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851288.361973:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851288.362097:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000872064 00000100:00100000:3.0:1788851288.362106:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000872064 00010000:00010000:3.0:1788851288.362165:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f91 expref: 17 pid: 17212 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851288.362224:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1788851288.362235:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+17:2408:x1875746000872064:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851288.362252:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851288.362259:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f91 expref: 17 pid: 17212 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.362294:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f91 expref: 17 pid: 17212 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.362319:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b20720a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f91 expref: 17 pid: 17212 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.362338:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:3.0:1788851288.362344:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.362353:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.362361:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.362395:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851288.362554:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+16:2408:x1875746000872064:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 319us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851288.362562:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00010000:00010000:0.0:1788851288.362667:0:18245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.362683:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851288.362793:0:18245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788851288.362912:0:18245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788851288.362950:0:18245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788851288.364520:0:18245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18245:1875746019823232:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788851288.364603:0:18245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851288.364650:0:18245:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851288.365725:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019823232 00000100:00100000:3.0:1788851288.365738:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019823232 00000100:00100000:3.0:1788851288.365815:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788851288.365826:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18245:x1875746019823232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788851288.365973:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18245:x1875746019823232:12345-0@lo:1000:mdt00_003.0 Request processed in 149us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851288.365981:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788851288.366287:0:18245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18245:1875746019823232:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788851288.366538:0:18245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788851288.366627:0:18245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18245:1875746019823360:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788851288.366668:0:18245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851288.366689:0:18245:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90913840 going to sleep for 11 seconds 00000100:00100000:2.0:1788851288.366811:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019823360 00000100:00100000:2.0:1788851288.366818:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019823360 00000100:00100000:2.0:1788851288.366859:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788851288.366869:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18245:x1875746019823360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788851288.366993:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18245:x1875746019823360:12345-0@lo:1000:mdt00_003.0 Request processed in 126us (323us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788851288.367000:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788851288.367540:0:18245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18245:1875746019823360:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788851288.367600:0:18245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367613:0:18245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367621:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367628:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851288.367633:0:18245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367662:0:18245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367679:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:0.0:1788851288.367681:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851288.367688:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367693:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c400/0x3e0030720b20723b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367736:0:18245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367743:0:18245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367750:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367755:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eeba200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851288.367759:0:18245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367765:0:18245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367774:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:0.0:1788851288.367776:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851288.367785:0:18245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f75 expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367816:0:18245:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f75 expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367829:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f75 expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.367896:0:18245:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f75 expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851288.367911:0:18245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019823488:192.168.204.27@tcp:105: 00000100:00100000:0.0:1788851288.367984:0:18245:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90913840 going to sleep for 11 seconds 00000100:00100000:0.0:1788851288.378805:0:18245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18245:1875746019823488:192.168.204.27@tcp:105: 00010000:00010000:0.0:1788851288.378841:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.378853:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20719a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.378889:0:18245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.378905:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.378918:0:18245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.378929:0:18245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851288.379257:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851288.379356:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000872192 00000100:00100000:3.0:1788851288.379365:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000872192 00000100:00100000:3.0:1788851288.379425:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1788851288.379437:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c93c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+20:15684:x1875746000872192:12345-192.168.204.27@tcp:49:dd.0 00000100:00100000:3.0:1788851288.379611:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c93c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+20:15684:x1875746000872192:12345-192.168.204.27@tcp:49:dd.0 Request processed in 175us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851288.379621:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00010000:00010000:0.0:1788851288.380143:0:18245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380152:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380158:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdabe00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851288.380163:0:18245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380172:0:18245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380199:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:0.0:1788851288.380202:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851288.380206:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380212:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabe00/0x3e0030720b207242 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380228:0:18245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380233:0:18245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380239:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380243:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851288.380257:0:18245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380263:0:18245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380270:0:18245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:0.0:1788851288.380272:0:18245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851288.380274:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.380280:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c800/0x3e0030720b207234 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851288.380572:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+19:15685:x1875746000871808:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 43299us (43620us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788851288.380581:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000020:00080000:0.0:1788851288.380586:0:18245:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788851288.381292:0:17246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788851288.381298:0:17246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788851288.381316:0:17246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788851288.381322:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788851288.396326:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851288.396409:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000872320 00000100:00100000:3.0:1788851288.396419:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000872320 00000100:00100000:3.0:1788851288.396483:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:3.0:1788851288.396564:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+19:15684:x1875746000872320:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:3.0:1788851288.396589:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851288.396612:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c000/0x3e0030720b207249 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38fa6 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.396652:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b207250 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.396668:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b207250 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.396680:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b207250 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.396806:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c000/0x3e0030720b207249 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38fa6 expref: 21 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.396825:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b207250 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38fa6 expref: 20 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.396846:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851288.396850:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851288.396854:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d400, rc 0) 00000100:00100000:3.0:1788851288.398112:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+20:15684:x1875746000872320:12345-192.168.204.27@tcp:101:dd.0 Request processed in 1543us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851288.398123:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1788851288.408679:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851288.412900:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000872576 00000100:00100000:3.0:1788851288.412919:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000872576 00000100:00100000:2.0:1788851288.416630:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:2.0:1788851288.416645:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+20:15685:x1875746000872576:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788851288.416951:0:17215:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788851288.416998:0:17215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788851288.417098:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.417115:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.417139:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.417148:0:17215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.417155:0:17215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.417161:0:17215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.417198:0:17215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788851288.417298:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+22:15685:x1875746000872576:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 655us (8634us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788851288.417306:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000020:00080000:2.0:1788851288.417312:0:17215:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788851288.418037:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851288.418047:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.418055:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851288.418061:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.418072:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.418090:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:3.0:1788851288.418093:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788851288.418098:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.418105:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94400/0x3e0030720b207257 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.418130:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851288.418132:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851288.418144:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851288.642091:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851288.642229:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000872704 00000100:00100000:2.0:1788851288.642241:0:18724:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000872704 00000100:00100000:2.0:1788851288.642312:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:2.0:1788851288.642323:0:18724:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+8:2408:x1875746000872704:12345-192.168.204.27@tcp:4:dd.0 00010000:00010000:2.0:1788851288.642364:0:18724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.642404:0:18724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f9f expref: 8 pid: 18721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.642415:0:18724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851288.642419:0:18724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851288.642424:0:18724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.642462:0:18724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f9f expref: 8 pid: 18721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.642477:0:18724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f9f expref: 8 pid: 18721 timeout: 722 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851288.642493:0:18724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18724:1875746019823616:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851288.642592:0:18724:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e98350a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851288.647931:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851288.648050:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788851288.648061:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788851288.649623:0:18724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18724:1875746019823616:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851288.649651:0:18724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851288.649742:0:18726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000872832 00000100:00100000:2.0:1788851288.649750:0:18726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000872832 00000100:00100000:1.0:1788851288.650295:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1788851288.650306:0:20350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:2408:x1875746000872832:12345-192.168.204.27@tcp:4:dd.0 00010000:00010000:1.0:1788851288.650340:0:20350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.650357:0:20350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851288.650362:0:20350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851288.650367:0:20350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.650383:0:20350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851288.664995:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851288.665104:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000872960 00000100:00100000:0.0:1788851288.665115:0:17199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000872960 00010000:00010000:0.0:1788851288.665234:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f9f expref: 10 pid: 18721 timeout: 722 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851288.665317:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1788851288.665328:0:17199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+10:2410:x1875746000872960:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851288.665349:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851288.665375:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f9f expref: 10 pid: 18721 timeout: 722 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.665411:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f9f expref: 10 pid: 18721 timeout: 722 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.665434:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000000f1c76/0x3e0030720b20721f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f9f expref: 10 pid: 18721 timeout: 722 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.665450:0:17199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851288.665454:0:17199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851288.665460:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.665470:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.665478:0:17199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851288.665480:0:17199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851288.665484:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.665491:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.665539:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851288.665594:0:17199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+9:2410:x1875746000872960:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 267us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851288.665601:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00010000:00010000:2.0:1788851288.665677:0:18724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851288.665686:0:18724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.668867:0:20350:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851288.668889:0:20350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851288.791353:0:19531:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788851288.791370:0:19531:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788851288.791739:0:20350:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1788851288.791745:0:20350:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788851286 -> 1788851288 00002000:00010000:1.0:1788851288.791747:0:20350:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788851286 -> 1788851288 00002000:00010000:1.0:1788851288.791750:0:20350:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1788851288.791767:0:20350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.791781:0:20350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.791791:0:20350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.791799:0:20350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eb000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851288.791804:0:20350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.791815:0:20350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.791843:0:20350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851288.791866:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6901700/0x3e0030720b207265 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851288.791982:0:20350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+7:2408:x1875746000872832:12345-192.168.204.27@tcp:4:dd.0 Request processed in 141671us (144055us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788851288.791995:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000001:00080000:2.0:1788851288.823784:0:19531:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1788851288.824141:0:18724:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1788851288.824163:0:18724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.824178:0:18724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.824201:0:18724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.824209:0:18724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851288.824215:0:18724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.824224:0:18724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.824245:0:18724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851288.824253:0:18724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c160b3f/0x3e0030720b20725e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851288.824419:0:18724:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000872704:12345-192.168.204.27@tcp:4:dd.0 Request processed in 182092us (182333us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788851288.824450:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00010000:00010000:1.0:1788851288.888248:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851289.012329:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019823872:0@lo:400:kworker.0 00000100:00100000:3.0:1788851289.012376:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019824128:0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.012400:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851289.012403:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851289.012502:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019824000:0@lo:400:kworker.0 00000100:00100000:0.0:1788851289.014522:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019823744:0@lo:400:kworker.0 00000100:00100000:3.0:1788851289.015643:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019824640:0@lo:400:kworker.0 00000100:00100000:3.0:1788851289.015750:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851289.015776:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019825152:0@lo:400:kworker.0 00000100:00100000:3.0:1788851289.015801:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851289.018452:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019824384:0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.018528:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851289.018572:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019823872 00000100:00100000:2.0:1788851289.018581:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019823872 00000100:00100000:2.0:1788851289.018629:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019824384 00000100:00100000:2.0:1788851289.018632:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019824384 00000100:00100000:2.0:1788851289.018648:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788851289.018657:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019823872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.018713:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019823872:12345-0@lo:400:kworker.0 Request processed in 56us (6312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851289.018720:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788851289.018737:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788851289.018743:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019824384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.018768:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019824384:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851289.018774:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788851289.018812:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019824384:0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.018822:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019824896:0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.018849:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851289.018879:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019823872:0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.018963:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019824128 00000100:00100000:2.0:1788851289.018968:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019824128 00000100:00100000:2.0:1788851289.018996:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019824640 00000100:00100000:2.0:1788851289.018999:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019824640 00000100:00100000:2.0:1788851289.019055:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788851289.019062:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019824128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.019102:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019824128:12345-0@lo:400:kworker.0 Request processed in 41us (6696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851289.019108:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788851289.019119:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851289.019125:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019824640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.019153:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019824640:12345-0@lo:400:kworker.0 Request processed in 28us (3404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851289.019159:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851289.019229:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019825408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851289.019254:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851289.019281:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019825152 00000100:00100000:2.0:1788851289.019286:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019825152 00000100:00100000:2.0:1788851289.019309:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019824896 00000100:00100000:2.0:1788851289.019311:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019824896 00000100:00100000:2.0:1788851289.019334:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788851289.019340:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87ab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019825152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.019372:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87ab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019825152:12345-0@lo:400:kworker.0 Request processed in 32us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851289.019378:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788851289.019390:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788851289.019396:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019824896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.019434:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019824896:12345-0@lo:400:kworker.0 Request processed in 38us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851289.019439:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788851289.019466:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019824896:0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.019500:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1788851289.019505:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892d8826a300, transno 8589934596 00000004:00080000:2.0:1788851289.019514:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1788851289.019529:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019824128:0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.019539:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019824640:0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.019553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019825152:0@lo:400:kworker.0 00000100:00100000:2.0:1788851289.019581:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019825408 00000100:00100000:2.0:1788851289.019584:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019825408 00000100:00100000:2.0:1788851289.019606:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788851289.019612:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019825408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851289.019625:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1788851289.019658:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019825408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851289.019664:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788851289.019678:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851289.019683:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851289.019703:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019825408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851289.019750:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851289.019756:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019825536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851289.019780:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851289.019810:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019825536 00000100:00100000:2.0:1788851289.019813:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019825536 00000100:00100000:2.0:1788851289.019832:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851289.019838:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019825536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851289.019847:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1788851289.019873:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019825536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851289.019879:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851289.019905:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019825536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851289.028696:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851289.028763:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019824512:0@lo:400:kworker.0 00000100:00100000:1.0:1788851289.028804:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851289.028844:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019825024:0@lo:400:kworker.0 00000100:00100000:1.0:1788851289.028870:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851289.029104:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019824000 00000100:00100000:3.0:1788851289.029113:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019824000 00000100:00100000:3.0:1788851289.029193:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019824512 00000100:00100000:3.0:1788851289.029196:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019824512 00000100:00100000:3.0:1788851289.029231:0:19145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851289.029242:0:19145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019824000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851289.029306:0:19145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019824000:12345-0@lo:400:kworker.0 Request processed in 66us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851289.029314:0:19145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851289.029361:0:19145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788851289.029368:0:19145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019824512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851289.029400:0:19145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019824512:12345-0@lo:400:kworker.0 Request processed in 32us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851289.029406:0:19145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788851289.029422:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851289.029855:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019825024 00000100:00100000:1.0:1788851289.029861:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019825024 00000100:00100000:1.0:1788851289.029911:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788851289.029918:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019825024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851289.030099:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019825024:12345-0@lo:400:kworker.0 Request processed in 181us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851289.030170:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788851289.030296:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019824000:0@lo:400:kworker.0 00000100:00100000:1.0:1788851289.030310:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019824512:0@lo:400:kworker.0 00010000:00080000:1.0:1788851289.030324:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b76680 x1875746019825024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851289.030534:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019825024:0@lo:400:kworker.0 00000100:00080000:3.0:1788851289.031130:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851289.035909:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851289.036060:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019824256:0@lo:400:kworker.0 00000100:00100000:0.0:1788851289.036104:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851289.036320:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019823744 00000100:00100000:1.0:1788851289.036329:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019823744 00000100:00100000:0.0:1788851289.036461:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019824768:0@lo:400:kworker.0 00000100:00100000:0.0:1788851289.036486:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851289.036507:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019825280:0@lo:400:kworker.0 00000100:00100000:0.0:1788851289.036526:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851289.036566:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019824256 00000100:00100000:0.0:1788851289.036576:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019824256 00000100:00100000:0.0:1788851289.036605:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019824768 00000100:00100000:0.0:1788851289.036608:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019824768 00000100:00100000:0.0:1788851289.036621:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019825280 00000100:00100000:0.0:1788851289.036623:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019825280 00000100:00100000:0.0:1788851289.036666:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788851289.036675:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019824256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851289.036728:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019824256:12345-0@lo:400:kworker.0 Request processed in 54us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851289.036735:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788851289.036752:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788851289.036759:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019824768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851289.036787:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019824768:12345-0@lo:400:kworker.0 Request processed in 29us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851289.036793:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788851289.036804:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788851289.036810:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019825280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851289.036866:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019825280:12345-0@lo:400:kworker.0 Request processed in 56us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851289.036873:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788851289.036889:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851289.036919:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019824256:0@lo:400:kworker.0 00000100:00100000:0.0:1788851289.036944:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019824768:0@lo:400:kworker.0 00010000:00080000:0.0:1788851289.036956:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b75880 x1875746019825280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851289.036966:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019825280:0@lo:400:kworker.0 00000100:00100000:1.0:1788851289.037863:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788851289.037881:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:3649:x1875746019823744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851289.037952:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:3649:x1875746019823744:12345-0@lo:400:kworker.0 Request processed in 79us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851289.037959:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788851289.038048:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019823744:0@lo:400:kworker.0 00000100:00100000:3.0:1788851289.524504:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851289.524539:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019825664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851289.524614:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851289.524789:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019825664 00000100:00100000:1.0:1788851289.524800:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019825664 00000100:00100000:1.0:1788851289.524859:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788851289.524869:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019825664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851289.524904:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851289.524967:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019825664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851289.524974:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788851289.525041:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019825664:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788851289.908710:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851290.036976:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019825792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851290.037077:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851290.037149:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019825792 00000100:00100000:1.0:1788851290.037167:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019825792 00000100:00100000:1.0:1788851290.037217:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788851290.037226:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019825792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788851290.037265:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788851290.037326:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019825792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851290.037333:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788851290.037381:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019825792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851290.042217:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019825920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851290.042298:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851290.046050:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019825920 00000100:00100000:2.0:1788851290.046064:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019825920 00000100:00100000:2.0:1788851290.046136:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788851290.046147:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019825920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788851290.046195:0:18246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788851290.056384:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019825920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10229us (14077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851290.056399:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788851290.056582:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019825920:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788851290.491495:0:20387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:1.0:1788851290.868924:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788851290.932288:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851291.573547:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019826048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851291.573649:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851291.573777:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019826048 00000100:00100000:2.0:1788851291.573814:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019826048 00000100:00100000:2.0:1788851291.573910:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788851291.573924:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019826048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851291.573966:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788851291.574301:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019826048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 379us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851291.574310:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788851291.574335:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851291.574415:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019826048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851291.893944:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851291.893982:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851291.894031:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851291.894059:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851291.894079:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851291.894092:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851291.894107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851291.894133:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851291.894287:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000873088 00000100:00100000:1.0:1788851291.894297:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000873088 00000100:00100000:1.0:1788851291.894348:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:1.0:1788851291.894358:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2408:x1875746000873088:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851291.894423:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2408:x1875746000873088:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 67us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851291.894431:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 168 00000100:00100000:2.0:1788851291.894749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851291.894781:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000873344 00000100:00100000:2.0:1788851291.894785:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000873344 00000100:00100000:2.0:1788851291.894818:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000873856 00000100:00100000:2.0:1788851291.894820:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000873856 00000100:00100000:2.0:1788851291.894833:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000873216 00000100:00100000:2.0:1788851291.894835:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000873216 00000100:00100000:2.0:1788851291.894847:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000873728 00000100:00100000:2.0:1788851291.894849:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000873728 00000100:00100000:2.0:1788851291.894862:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1788851291.894869:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000873344:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851291.894907:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000873344:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 38us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851291.894913:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1788851291.894926:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:2.0:1788851291.894932:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000873856:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851291.894954:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000873856:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851291.894960:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:2.0:1788851291.894971:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1788851291.894991:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+22:2408:x1875746000873216:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851291.895046:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+22:2408:x1875746000873216:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 55us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851291.895059:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:2.0:1788851291.895071:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:2.0:1788851291.895078:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2408:x1875746000873728:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851291.895102:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2408:x1875746000873728:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 25us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851291.895108:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:2.0:1788851291.895141:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000873600 00000100:00100000:2.0:1788851291.895145:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000873600 00000100:00100000:2.0:1788851291.895423:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000874112 00000100:00100000:2.0:1788851291.895427:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000874112 00000100:00100000:2.0:1788851291.895439:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000873472 00000100:00100000:2.0:1788851291.895442:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000873472 00000100:00100000:2.0:1788851291.895452:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000873984 00000100:00100000:2.0:1788851291.895455:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000873984 00000100:00100000:2.0:1788851291.895467:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1788851291.895473:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000873600:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851291.895500:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000873600:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851291.895506:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1788851291.895517:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:2.0:1788851291.895523:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000874112:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851291.895543:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000874112:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 20us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851291.895558:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:2.0:1788851291.895570:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1788851291.895576:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000873472:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851291.895598:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000873472:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851291.895604:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1788851291.895613:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:2.0:1788851291.895619:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000873984:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851291.895656:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000873984:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851291.895662:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00080000:2.0:1788851291.895681:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851291.895684:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788851291.895687:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851291.895689:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788851291.958224:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42844 lines, 42844 kept, 0 dropped, 0 bad.